Reinforcer satiation and resistance to change of responding maintained by qualitatively different reinforcers

In previous research on resistance to change, differential disruption of operant behavior by satiation has been used to assess the relative strength of responding maintained by different rates or magnitudes of the same reinforcer in different stimulus contexts. The present experiment examined resistance to disruption by satiation of one reinforcer type when qualitatively different reinforcers were arranged in different contexts. Rats earned either food pellets or a 15% sucrose solution on variable-interval 60-s schedules of reinforcement in the two components of a multiple schedule. Resistance to satiation was assessed by providing free access either to food pellets or the sucrose solution prior to or during sessions. Responding systematically decreased more relative to baseline in the component associated with the satiated reinforcer. These findings suggest that when qualitatively different reinforcers maintain responding, relative resistance to change depends upon the relations between reinforcers and disrupter types.     

Resistance to change in goldfish

Resistance to change has been studied in several species such as humans, rats, and pigeons. We conducted two experiments using goldfish as subjects to examine the generality of the findings on resistance to change in a phylogenetically more primitive species. In Experiment 1, five goldfish (Carassius auratus) were trained on two-component multiple schedules with different variable-interval schedules in effect. When responding was disrupted by presenting free food during intercomponent intervals or by extinction, resistance to change was greater in the component with the higher reinforcement rates. In Experiment 2, identical variable-interval schedules were presented in two multiple-schedule components, but in one of the components response-independent food was delivered concurrently according to variable-time schedules. Baseline response rates were the same for both components, which is inconsistent with previous findings with other species that the addition of response-independent food decreases response rates. However, response rates in the component with added response-independent food showed the greater resistance to change, which is similar to findings in other species. The convergence of these results across various species confirms the generality of the findings on resistance to change.     

Effect of unsignaled delays between stimuli in a chain schedule on responding and resistance to change

Behavioral momentum theory is an evolving theoretical account of the strength of behavior. One challenge for the theory is determining the role of signal stimuli in determining response strength. This study evaluated the effect of an unsignaled delay between the initial link and terminal link of a two-link chain schedule on resistance to change using a multiple schedule of reinforcement. Pigeons were presented two different signaled delay to reinforcement schedules. Both schedules employed a two-link chain schedule with a variable interval 120-s initial link followed by a 5-s fixed time terminal link schedule. One of the schedules included a 5-s unsignaled delay between the initial link and the terminal link. Resistance to change was assessed with two separate disruption procedures: extinction and adding a variable time 20-s schedule of reinforcement to the inter-component interval. Baseline responding was lower in the schedule with the unsignaled delay but resistance to change for the initial link was unaffected by the unsignaled delay. The results suggest that not all unsignaled delays are equal in their effect on resistance to change.     

Operant conditioning of skin resistance tonic levels

The purpose of the current investigation was to determine whether increases and decreases in skin resistance tonic level could be controlled by individuals given discrete visual feedback of such activity. Thirty-six male undergraduate students served as subjects. They were assigned randomly in equal numbers to four groups; two of the groups received accurate feedback of skin resistance level changes and two received inaccurate feedback. The two accurate-feedback groups differed with respect to the order in which increases and decreases in skin resistance level were reinforced. Each noncontingent group was matched with one of the contingent groups in terms of reinforcement density. The results indicated that accurate feedback produced skin resistance level changes consistent with the type of reinforcement employed. However, operant control was not clearly sustained subsequent to a reversal in the type of tonic level change reinforced. Some problems related to the clinical application of skin resistance level training are discussed.     

Response-reinforcer relations and resistance to change

Behavioral momentum theory suggests that the relation between a response and a reinforcer (i.e., response-reinforcer relation) governs response rates and the relation between a stimulus and a reinforcer (i.e., stimulus-reinforcer relation) governs resistance to change. The present experiments compared the effects degrading response-reinforcer relations with response-independent or delayed reinforcers on resistance to change in conditions with equal stimulus-reinforcer relations. In Experiment 1, pigeons responded on equal variable-interval schedules of immediate reinforcement in three components of a multiple schedule. Additional response-independent reinforcers were available in one component and additional delayed reinforcers were available in another component. The results showed that resistance to disruption was greater in the components with added reinforcers than without them (i.e., better stimulus-reinforcer relations), but did not differ for the components with added response-independent and delayed reinforcement. In Experiment 2, a component presenting immediate reinforcement alternated with either a component that arranged equal rates of reinforcement with a proportion of those reinforcers being response independent or a component with a proportion of the reinforcers being delayed. Results showed that resistance to disruption tended to be either similar across components or slightly lower when response-reinforcer relations were degraded with either response-independent or delayed reinforcers. These findings suggest that degrading response-reinforcer relations can impact resistance to change, but that impact does not depend on the specific method and is small relative to the effects of the stimulus-reinforcer relation.     

Operant conditioning of skin resistance tonic levels

The purpose of the current investigation was to determine whether increases and decreases in skin resistance tonic level could be controlled by individuals given discrete visual feedback of such activity. Thirty-six male undergraduate students served as subjects. They were assigned randomly in equal numbers to four groups; two of the groups received accurate feedback of skin resistance level changes and two received inaccurate feedback. The two accurate-feedback groups differed with respect to the order in which increases and decreases in skin resistance level were reinforced. Each noncontingent group was matched with one of the contingent groups in terms of reinforcement density. The results indicated that accurate feedback produced skin resistance level changes consistent with the type of reinforcement employed. However, operant control was not clearly sustained subsequent to a reversal in the type of tonic level change reinforced. Some problems related to the clinical application of skin resistance level training are discussed.Portions of this paper were presented at the meeting of the Midwestern Psychological Association, Chicago, 1973.     

Companion's effects upon resistance to change

In order to investigate the effects of a companion's presence on resistance to change, five rats were trained under a multiple schedule comprised of components with high versus low rate of water reinforcement. After response rates became stable, water was given to the subjects prior to the experimental sessions, and these were conducted both in the absence and in the presence of a companion, which also could be responding or merely present. Results showed that the companion's presence increased resistance to satiation, mainly during the component with the higher reinforcement rate. These results suggest that the effect of the companion's presence may interact with reinforcement rate in determining response rate and resistance to satiation.     

Measuring behavioral momentum

The metaphor of behavioral momentum proposes that when ongoing operant behavior is disrupted, changes in response rate are directly related to a force-like aspect of the disruptor and inversely proportional to behavioral mass. Several data sets suggest that differential resistance to change between the components of a multiple schedule satisfies the requirements of a ratio scale and is additive when different disruptors and different dimensions of reinforcement are combined. Differential resistance also provides a basis for scaling force in relation to rate of food presentation between components as a disruptor, and for scaling mass in relation to food rate within a component as a reinforcer. Preference in concurrent chains with terminal links identical to multiple-schedule components also meets the requirements of ratio-scale measurement, is additive when different dimensions of reinforcement are combined, and provides convergent measurement of behavioral mass.     

Modulation of habit formation by levodopa in Parkinson's disease

Dopamine promotes the execution of positively reinforced actions, but its role for the formation of behaviour when feedback is unavailable remains open. To study this issue, the performance of treated/untreated patients with Parkinson's disease and controls was analysed in an implicit learning task, hypothesising dopamine-dependent adherence to hidden task rules. Sixteen patients on/off levodopa and fourteen healthy subjects engaged in a Go/NoGo paradigm comprising four equiprobable stimuli. One of the stimuli was defined as target which was first consistently preceded by one of the three non-target stimuli (conditioning), whereas this coupling was dissolved thereafter (deconditioning). Two task versions were presented: in a 'Go version', only the target cue required the execution of a button press, whereas non-target stimuli were not instructive of a response; in a 'NoGo version', only the target cue demanded the inhibition of the button press which was demanded upon any non-target stimulus. Levodopa influenced in which task version errors grew from conditioning to deconditioning: in unmedicated patients just as controls errors only rose in the NoGo version with an increase of incorrect responses to target cues. Contrarily, in medicated patients errors went up only in the Go version with an increase of response omissions to target cues. The error increases during deconditioning can be understood as a perpetuation of reaction tendencies acquired during conditioning. The levodopa-mediated modulation of this carry-over effect suggests that dopamine supports habit conditioning under the task demand of response execution, but dampens it when inhibition is required. However, other than in reinforcement learning, supporting dopaminergic actions referred to the most frequent, i. e., non-target behaviour. Since this is passive whenever selective actions are executed against an inactive background, dopaminergic treatment could in according scenarios contribute to passive behaviour in patients with Parkinson's disease.     

Role of a Novel I1781T Mutation and Other Mechanisms in Conferring Resistance to Acetyl-CoA Carboxylase Inhibiting Herbicides in a Black-Grass Population

Background

Knowledge of the mechanisms of herbicide resistance is important for designing long term sustainable weed management strategies. Here, we have used an integrated biology and molecular approach to investigate the mechanisms of resistance to acetyl-CoA carboxylase inhibiting herbicides in a UK black-grass population (BG2).

Methodology/Principal Findings

Comparison between BG2 phenotypes using single discriminant rates of herbicides and genotypes based on ACCase gene sequencing showed that the I1781L, a novel I1781T, but not the W2027C mutations, were associated with resistance to cycloxydim. All plants were killed with clethodim and a few individuals containing the I1781L mutation were partially resistant to tepraloxydim. Whole plant dose response assays demonstrated that a single copy of the mutant T1781 allele conferred fourfold resistance levels to cycloxydim and clodinafop-propargyl. In contrast, the impact of the I1781T mutation was low (Rf = 1.6) and non-significant on pinoxaden. BG2 was also characterised by high levels of resistance, very likely non-target site based, to the two cereal selective herbicides clodinafop-propargyl and pinoxaden and not to the poorly metabolisable cyclohexanedione herbicides. Analysis of 480 plants from 40 cycloxydim resistant black grass populations from the UK using two very effective and high throughput dCAPS assays established for detecting any amino acid changes at the 1781 ACCase codon and for positively identifying the threonine residue, showed that the occurrence of the T1781 is extremely rare compared to the L1781 allele.

Conclusion/Significance

This study revealed a novel mutation at ACCase codon position 1781 and adequately assessed target site and non-target site mechanisms in conferring resistance to several ACCase herbicides in a black-grass population. It highlights that over time the level of suspected non-target site resistance to some cereal selective ACCase herbicides have in some instances surpassed that of target site resistance, including the one endowed by the most commonly encountered I1781L mutation.     

The production and generalization of large-magnitude heart rate deceleration by contingently faded biofeedback

Eight subjects were taught to decrease their heart rates via biofeedback training. Four of these received contingently faded, beat-by-beat analogue feedback and contingent reinforcement each time their performance met a specified and adjusting criterion. The other four received continuous, beat-by-beat analogue feedback, but not the contingent reinforcement. Subjects in the two groups were yoked to ensure equal densities of reinforcement. Subjects in the first group were asked to decrease heart rates 15% from baseline and were then trained using only 75%, 50% and 25% of beat-by-beat feedback. It was hypothesized that the immediate reinforcement of appropriate behavior and the contingent fading(following mastery) of feedback would aid in the generalization of the response. Following completion of all criterion steps or 10 training sessions, whichever came first, all subjects were tested with no feedback and no contingent reinforcement. The group receiving contingently faded feedback training showed a significantly greater heart rate decrease in the training sessions and also the test session. These results were interpreted as indicating that biofeedback can be conceptualized as an operant conditioning paradigm, and that the use of operant techniques may help subjects produce clinically significant changes.This research was supported in part by a grant to Robert J. Gatchel from the National Heart, Lung, and Blood Institute (Grant No. NIH HL 21426-01).     

Functionally independent components of early event-related potentials in a visual spatial attention task.

Spatial visual attention modulates the first negative-going deflection in the human averaged event-related potential (ERP) in response to visual target and non-target stimuli (the N1 complex). Here we demonstrate a decomposition of N1 into functionally independent subcomponents with functionally distinct relations to task and stimulus conditions. ERPs were collected from 20 subjects in response to visual target and non-target stimuli presented at five attended and non-attended screen locations. Independent component analysis, a new method for blind source separation, was trained simultaneously on 500 ms grand average responses from all 25 stimulus-attention conditions and decomposed the non-target N1 complexes into five spatially fixed, temporally independent and physiologically plausible components. Activity of an early, laterally symmetrical component pair (N1aR and N1aL) was evoked by the left and right visual field stimuli, respectively. Component N1aR peaked ca. 9 ms earlier than N1aL. Central stimuli evoked both components with the same peak latency difference, producing a bilateral scalp distribution. The amplitudes of these components were no reliably augmented by spatial attention. Stimuli in the right visual field evoked activity in a spatio-temporally overlapping bilateral component (N1b) that peaked at ca. 180 ms and was strongly enhanced by attention. Stimuli presented at unattended locations evoked a fourth component (P2a) peaking near 240 ms. A fifth component (P3f) was evoked only by targets presented in either visual field. The distinct response patterns of these components across the array of stimulus and attention conditions suggest that they reflect activity in functionally independent brain systems involved in processing attended and unattended visuospatial events.     

Resistance to extinction, generalization decrement, and conditioned reinforcement

This study investigated generalization decrement during an extinction resistance-to-change test for pigeon key pecking using a two-component multiple schedule with equal variable-interval 3-min schedules and different reinforcer amounts (one component presented 2-s access to reinforcement and the other 8s). After establishing baseline responding, subjects were assigned to one of the two extinction conditions: hopper stimuli (hopper and hopper light were activated but no food was available) or Control (inactive hopper and hopper light). Responding in the 8-s component was more resistant to extinction than responding in the 2-s component, the hopper stimuli group was more resistant to extinction compared to the Control group, and an interaction between amount of reinforcement, extinction condition, and session block was present. This finding supports generalization decrement as a factor that influences resistance to extinction. Hopper-time data (the amount of time subjects spent with their heads in the hopper) were compared to resistance-to-change data in an investigation of the role of conditioned reinforcement on resistance to change.     

Transitional choice behavior in concurrent-chain schedules

The choice responses of four pigeons were examined in 20 periods of transition in a concurrent-chain procedure with variable-interval schedules as initial links and fixed delays to reinforcement as terminal links. In some conditions, the delays to reinforcement were different for the two terminal links, and changes in preference were recorded after the delays for the two response keys were switched. In other conditions, the reinforcer delays were equal for the two keys, but which key delivered 80% of the reinforcers was periodically switched. Choice proportions changed more quickly after a switch in reinforcement percentages than after a switch in the delays, thereby contradicting the hypothesis that faster changes would occur when the switch in conditions was easier to discriminate. Analyses of response sequences showed that the effects of individual reinforcers were larger and lasted longer in conditions with changing reinforcement percentages than in conditions with changing terminal-link delays. Rates of change in choice behavior do not appear to be limited by the unpredictability of variable reinforcement schedules, because the changes in behavior were slow and gradual even when there was a large and sudden change in reinforcer delays.     

Nesting material as a reinforcer for female mice

Seven virgin female mice of strain RAP (albino) were trained to key-press, using paper as a reinforcer. Their behaviour was recorded when paper was delivered non-contingently, and when it was contingent upon key-pressing on CRF and FR schedules. When the contingency was introduced, the number of pieces of paper taken decreased. As fixed ratio size was increased, the overall response rate remained constant, and the reinforcement rate declined. The sequence of nest-building activities which accompanied delivery of paper was also observed to change as a function of schedule.     

Target and Non-Target Processing during Oddball and Cyberball: A Comparative Event-Related Potential Study

The phenomenon of social exclusion can be investigated by using a virtual ball-tossing game called Cyberball. In neuroimaging studies, structures have been identified which are activated during social exclusion. But to date the underlying mechanisms are not fully disclosed. In previous electrophysiological studies it was shown that the P3 complex is sensitive to exclusion manipulations in the Cyberball paradigm and that there is a correlation between P3 amplitude and self-reported social pain. Since this posterior event-related potential (ERP) was widely investigated using the oddball paradigm, we directly compared the ERP effects elicited by the target (Cyberball: “ball possession”) and non-target (Cyberball: “ball possession of a co-player) events in both paradigms. Analyses mainly focused on the effect of altered stimulus probabilities of the target and non-target events between two consecutive blocks of the tasks. In the first block, the probability of the target and non-target event was 33% (Cyberball: inclusion), in the second block target probability was reduced to 17%, and accordingly, non-target probability was increased to 66% (Cyberball: exclusion). Our results indicate that ERP amplitude differences between inclusion and exclusion are comparable to ERP amplitude effects in a visual oddball task. We therefore suggest that ERP effects–especially in the P3 range–in the Oddball and Cyberball paradigm rely on similar mechanisms, namely the probability of target and non-target events. Since the simulation of social exclusion (Cyberball) did not trigger a unique ERP response, the idea of an exclusion-specific neural alarm system is not supported. The limitations of an ERP-based approach will be discussed.     

Mathematical principles of reinforcement and resistance to change

Although Killeen's mathematical principles of reinforcement (MPR) apply to the asymptotic rate of a free operant after extended exposure to a single schedule of reinforcement, they can be extended to resistance to change in multiple schedules via alterations in the parameter representing the activating effects of reinforcers. MPR's predictions of resistance to change in relation to reinforcer rate on variable-interval (VI) schedules are empirically correct and agree with behavioral momentum theory (BMT). However, both MPR and BMT encounter problems in accounting for the effects of delayed reinforcement on resistance to change, relative to immediate reinforcement at the same rate. Further problems are raised by differences in resistance to change between variable-ratio (VR) and variable-interval performances maintained by the same reinforcer rate. With both delayed versus immediate reinforcement and variable-ratio versus variable-interval reinforcement, differential resistance to change is negatively correlated with the log ratios of baseline response rates when reinforcer rates are equated. Cases where resistance to change varies despite equated reinforcer rates, and the correlations among behavioral measures, provide challenges and opportunities for both MPR and BMT.     

The Effect of Similarity: Non-Spatial Features Modulate Obstacle Avoidance

The introduction of non-target objects into a workspace leads to temporal and spatial adjustments of reaching trajectories towards a target. If the non-target is obstructing the path of the hand towards the target, the reach is adjusted such that collision with the non-target, or obstacle, is avoided. Little is known about the influence of features which are irrelevant for the execution of the movement on avoidance movements, like color similarity between target and non-target objects. In eye movement studies the similarity of non-targets has been revealed to influence oculomotor competition. Because of the tight neural and behavioral coupling between the gaze and reaching system, our aim was to determine the contribution of similarity between target and non-target to avoidance movements. We performed 2 experiments in which participants had to reach to grasp a target object while a non-target was present in the workspace. These non-targets could be either similar or dissimilar in color to the target. The results indicate that the non-spatial feature similarity can further modify the avoidance response and therefore further modify the spatial path of the reach. Indeed, we find that dissimilar pairs have a stronger effect on reaching-to-grasp movements than similar pairs. This effect was most pronounced when the non-target was on the outside of the reaching hand, where it served as more of an obstacle to the trailing arm. We propose that the increased capture of attention by the dissimilar obstacle is responsible for the more robust avoidance response.     

Designing gene drives to limit spillover to non-target populations

The prospect of utilizing CRISPR-based gene-drive technology for controlling populations has generated much excitement. However, the potential for spillovers of gene-drive alleles from the target population to non-target populations has raised concerns. Here, using mathematical models, we investigate the possibility of limiting spillovers to non-target populations by designing differential-targeting gene drives, in which the expected equilibrium gene-drive allele frequencies are high in the target population but low in the non-target population. We find that achieving differential targeting is possible with certain configurations of gene-drive parameters, but, in most cases, only under relatively low migration rates between populations. Under high migration, differential targeting is possible only in a narrow region of the parameter space. Because fixation of the gene drive in the non-target population could severely disrupt ecosystems, we outline possible ways to avoid this outcome. We apply our model to two potential applications of gene drives—field trials for malaria-vector gene drives and control of invasive species on islands. We discuss theoretical predictions of key requirements for differential targeting and their practical implications.     

Gender difference in N170 elicited under oddball task

Background

Some studies have reported gender differences in N170, a face-selective event-related potential (ERP) component. This study investigated gender differences in N170 elicited under oddball paradigm in order to clarify the effect of task demand on gender differences in early facial processing.

Findings

Twelve males and 10 females discriminated targets (emotional faces) from non-targets (emotionally neutral faces) under an oddball paradigm, pressing a button as quickly as possible in response to the target. Clear N170 was elicited in response to target and non-target stimuli in both males and females. However, females showed more negative amplitude of N170 in response to target compared with non-target, while males did not show different N170 responses between target and non-target.

Conclusions

The present results suggest that females have a characteristic of allocating attention at an early stage when responding to faces actively (target) compared to viewing faces passively (non-target). This supports previous findings suggesting that task demand is an important factor in gender differences in N170.