Operant conditioning of brain steady potential shifts in man

Steady potential shifts (SPS) recorded from the scalp were conditioned operantly by visual and acoustical feedback. Three groups of seven subjects were each tested with a different response-reinforcement contingency: positive reinforcement for a positive SPS after a cue stimulus, positive reinforcement for a negative SPS after a cue stimulus, and noncontingent reinforcement. The steady potential shifts learned under these three conditions differed significantly. Negative shifts were associated with subjective feelings of activation, positive shifts with inactivation. Cortical genesis and possible artifacts are discussed.This research was supported by a grant from theFond zur Förderung der wissenschaftlichen Forschung.     

Operant conditioning of brain steady potential shifts in man.

Steady potential shifts (SPS) recorded from the scalp were conditioned operantly by visual and acoustical feedback. Three groups of seven subjects were each tested with a different response-reinforcement contingency: positive reinforcement for a positive SPS after a cue stimulus, positive reinforcement for a negative SPS after a cue stimulus, and noncontingent reinforcement. The steady potential shifts learned under these three conditions differed significantly. Negative shifts were associated with subjective feelings of activation, positive shifts with inactivation. Cortical genesis and possible artifacts are discussed.     

Operant conditioning in invertebrates

Learning to anticipate future events on the basis of past experience with the consequences of one's own behavior (operant conditioning) is a simple form of learning that humans share with most other animals, including invertebrates. Three model organisms have recently made significant contributions towards a mechanistic model of operant conditioning, because of their special technical advantages. Research using the fruit fly Drosophila melanogaster implicated the ignorant gene in operant conditioning in the heat-box, research on the sea slug Aplysia californica contributed a cellular mechanism of behavior selection at a convergence point of operant behavior and reward, and research on the pond snail Lymnaea stagnalis elucidated the role of a behavior-initiating neuron in operant conditioning. These insights demonstrate the usefulness of a variety of invertebrate model systems to complement and stimulate research in vertebrates.     

Operant conditioning of scratching in lemurs

An adult femaleLemur catta and an adult femaleEulemur fulvus were given edible rewards for scratching. Both subjects learned to scratch in order to obtain the rewards, showed diminished rates of scratching during periods of extinction, and learned to scratch preferentially with one foot when required. TheLemur catta subject was more responsive to the changing experimental conditions than theEulemur fulvus. The conditionability of scratching in primates does not appear to be directly related to the widespread occurrence of scratching in simian social contexts.     

Operant conditioning in the ant Myrmica sabuleti

Operant conditioning could be obtained in the ant Myrmica sabuleti by presenting to the workers, during a six-day period, an apparatus containing either sugared water or meat as a reward. The conditioning obtained using sugared water as a reward was short lasting. A reconditioning was more persistent and lasted four hours. The ants' response was very precise, since they exhibited it only in front of an apparatus identical to that used during the training phase. Operant conditioning obtained using meat as a reward was more pronounced than that obtained by using sugared water, probably because meat is more valuable as a reward than sugar for the species studied, which is essentially a carnivorous one. Such a conditioning was rather persistent. Indeed, a first operant conditioning obtained by using meat as a reward could still be detected after seven hours, and a reconditioning was still significant after eight hours. One day after this eight-hour period without rewarding the ants, the response was higher again and a further day later, it was still significant. Since the operant conditioning is easy to perform and quantify and since the ants' response is very precise, such a conditioning can be used for further studying M. sabuleti workers' visual perception.     

Somatosensory cortical unit responses during avoidance conditioning to sound

Unit responses of the primary somatosensory cortical-projection area were recorded in cats with established conditioned avoidance to sound during the conditioned response. Five types of changes in unit activity were distinguished during the conditioned reflex. The responses were 400–1000 msec in duration; their time of onset coincided with that of the expected reinforcing stimulus. As a rule the change in unit activity was preceded by changes in the electromyogram of the corresponding limb muscles. Among neurons responding to the conditioning stimulus, the proportion with a short latent period of response to electrical stimulation of the skin was less than during investigation of ordinary unit responses to the same stimulus.     

Operant conditioning of skin resistance tonic levels

The purpose of the current investigation was to determine whether increases and decreases in skin resistance tonic level could be controlled by individuals given discrete visual feedback of such activity. Thirty-six male undergraduate students served as subjects. They were assigned randomly in equal numbers to four groups; two of the groups received accurate feedback of skin resistance level changes and two received inaccurate feedback. The two accurate-feedback groups differed with respect to the order in which increases and decreases in skin resistance level were reinforced. Each noncontingent group was matched with one of the contingent groups in terms of reinforcement density. The results indicated that accurate feedback produced skin resistance level changes consistent with the type of reinforcement employed. However, operant control was not clearly sustained subsequent to a reversal in the type of tonic level change reinforced. Some problems related to the clinical application of skin resistance level training are discussed.Portions of this paper were presented at the meeting of the Midwestern Psychological Association, Chicago, 1973.     

Operant conditioning of skin resistance tonic levels

The purpose of the current investigation was to determine whether increases and decreases in skin resistance tonic level could be controlled by individuals given discrete visual feedback of such activity. Thirty-six male undergraduate students served as subjects. They were assigned randomly in equal numbers to four groups; two of the groups received accurate feedback of skin resistance level changes and two received inaccurate feedback. The two accurate-feedback groups differed with respect to the order in which increases and decreases in skin resistance level were reinforced. Each noncontingent group was matched with one of the contingent groups in terms of reinforcement density. The results indicated that accurate feedback produced skin resistance level changes consistent with the type of reinforcement employed. However, operant control was not clearly sustained subsequent to a reversal in the type of tonic level change reinforced. Some problems related to the clinical application of skin resistance level training are discussed.     

Dynamics of cortical unit responses during defensive conditioning to sound

Several phases were distinguished in single-unit responses in areas 3 and 4 during defensive conditioning to acoustic stimulation: an initial response, short inhibition of the spike discharge, early and late after-discharges, and changes arising after the end of acoustic stimulation. The initial spike response appeared or intensified (if present already) in the first period of defensive conditioning parallel with an increase in spontaneous unit activity. After-discharges appeared later. The conditioned-reflex movement usually began 100–400 msec after stimulation began. This latent period of the first movement was the same whether for a real conditioned reflex or an after-discharge. Comparison of the latent periods of conditioned movements with the phases of the unit responses showed that the conditioned responses of the cortical neuron were primarily modified after-discharges of neurons evoked by a conditioned stimulus. Differential unit responses to acoustic stimulation, also based on after-discharges, were formed just as actively as positive. The basic role of reinforcement during conditioning is not to increase the excitability of the neurons, which is important in connection with their acquisition of polysensory properties, but to modify the after-discharges of the neurons.A. A. Bogomolets Institute of Physiology, Academy of Sciences of the Ukrainian SSR, Kiev. Translated from Neirofiziologiya, Vol. 10, No. 4, pp. 339–347, July–August, 1978.     

Operant conditioning of small birds for acoustic discrimination

Standard operant conditioning techniques have been successfully applied to the problem of call discrimination in small birds. Budgerigars (Melopsittacus undulatus) and canaries (Serinus canarius) were trained with a GO/NOGO procedure using positive reinforcement to discriminate between both conspecific contact calls and contact calls of the other species. Budgerigars showed equal facility at each task. By contrast, canaries learned the task involving conspecific contact calls but failed, as a group, to discriminate between budgerigar contact calls. These results show that conditioning techniques can be used to study perceptual learning of species typical calls in small birds.     

Operant GSR conditioning with cool air reinforcement.

Two groups of 20 Ss each run individually in a soundproff chamber heated to 115 F and humidified to 100%. Ss in the experimental group received brief presentation of cool air contingent upon wmitted GSRs during 20 min of acquisition. Control Ss were matched on at a time in operant rate and were yoked one at a time to receive the cool air on a response-independent schedule. Both groups increased significantly in rate of unelicited GSRs during acquisition, with the experimental Ss' curve rising more rapidly and both groups attaining equivalent terminal levels. During extinction, the groups maintained high levels of responding and did not differ. Examination of basal skin conductance data ruled our an activation hypothesis. In the control Ss, terminal response frequency was significantly correlated with percentage of fortuitous response-contigent reinforcement. It was concluded that both croups were conditioned, with the controls receiving intermittent reinforcement sufficiently often to elevate their responding. The cool air was judged to be an effective reinforcer of unelicited GSRs, perhaps more effective than those used in previous studies.     

CNV-like potentials on the cortical surface associated with conditioning in head-restrained rats

Head-restrained rats were conditioned to perform a CNV task: to press a lever in response to an imperative auditory stimulus (S2) given 1.5 sec after a warning stimulus (S1) for a drop of jelly food. With an electrode on the surface of the forelimb cortex, (1) sharp wave complexes immediately after S1 and S2, and (2) a negative slow potential (SP) between S1 and S2, on which early and late components were discernible, were recorded in association with performance of this task. With the electrode at a depth of 2 mm in the same cortical area, the corresponding field potential showed a long-lasting positive shift in addition to the components of the surface potential. These monopolar recordings were obtained with respect to a common reference at the frontal sinus. The surface-minus-depth potential (the transcortical potential), consequently, showed a surface-negative tonic wave, confirming Pirch's report (1980). During extinction of this conditioning, the SP between S1 and S2 disappeared, while the sharp waves following S1 and S2 remained with little modification, suggesting that the sharp waves are a kind of evoked potential (EP) elicited by the stimuli.Recording from 5 surface electrodes set in an array over the left hemisphere contralateral to the used forelimb during development of the conditioning revealed not only a spatial distribution of the SP but also a transition of the potentials. As the conditioning progressed, the negativity of the early SP component tended to increase, while that of the late component tended to decrease and was confined to the sensorimotor cortex. The similarities of the rat cortical surface potentials to the human and monkey CNV in their wave form and function suggests that the rat brain can produce electrical activity analogous to the human CNV.     

Operant conditioning and behavioral analyses using a minicomputer.

An operant conditioning and data analysis software system was developed for use on a PDP-12A minicomputer. The operant software functions in quasi time-sharing fashion to control and acquire data from any peripheral device that operates in the binary mode. In addition to independently running different experiments in near simultaneous fashion, the program also provides information on the current status of each experiment using a cathode ray-tube display. Response data from each experimental subject is stored on magnetic tape and analyzed, off-line, by the data analysis portion of the software system. A discussion of the operation of this system is given for one possible application: visual discrimination training.     

Operant conditioning of EEG rhythms and ritalin in the treatment of hyperkinesis

Enhanced voluntary motor inhibition regularly accompanies conditioned increases in the sensorimotor rhythm (SMR), a 12–14-Hz Rolandic EEG rhythm in cats. A similar rhythm, presumably SMR, has also been identified in the human EEG. The clinical effectiveness of SMR operant conditioning has been claimed for epilepsy, insomnia, and hyperkinesis concurrent with seizure disorders. The present report attempts to follow up and replicate preliminary findings that suggested the technique's successful application to hyperkinesis uncomplicated by a history of epilepsy. SMR was defined as 12–14-Hz EEG activity in the absence of high-voltage slow-wave activity between 4 and 7 Hz. Anticipated treatment effects were indexed by systematic behavioral assessments of undirected motor activity and short attention span in the classroom. EEG and behavioral indices were monitored in four hyperkinetic children under the following six conditions: (1) No Drug, (2) Drug Only, (3) Drug and SMR Training I, (4) Drug and SMR Reversal Training, (5) Drug and SMR Training II, (6) No Drug and SMR Training. All hyperkinetic subjects were maintained on a constant drug regimen throughout the phases employing chemotherapy. Contingent increases and decreases in SMR occurred in three of four training subjects and were associated with similar changes in classroom assessments of motor inactivity. Combining medication and SMR training resulted in substantial improvements that exceeded the effects of drugs alone and were sustained with SMR training after medication was withdrawn. In contrast, these physiological and behavioral changes were absent in one highly distractible subject who failed to acquire the SMR task. Finally, pretraining levels of SMR accurately reflected both the severity of original motor deficits and the susceptibility of hyperkinetic subjects to both treatments. Although the procedure clearly reduced hyperkinetic behavior, a salient, specific therapeutic factor could not be identified due to the dual EEG contingency imposed combined with associated changes in EMG. Despite these and other qualifying factors, the findings suggested the prognostic and diagnostic value of the SMR in the disorder when overactivity rather than distractibility is the predominant behavioral deficit.     

Operant conditioning of EEG rhythms and ritalin in the treatment of hyperkinesis

Enhanced voluntary motor inhibition regularly accompanies conditioned increases in the sensorimotor rhythm (SMR), a 12--14-Hz Rolandic EEG rhythm in cats.A similar rhythm, presumably SMR, has also been identified in the human EEG. The clinical effectiveness of SMR operant conditioning has been claimed for epilepsy, insomnia, and hyperkinesis concurrent with seizure disorders. The present report attempts to follow up and replicate preliminary findings that suggested the technique's successful application to hyperkinesis uncomplicated by a history of epilepsy. SMR was defined as 12--14-Hz EEG activity in the absence of high-voltage slow-wave activity between 4 and 7 Hz. Anticipated treatment effects were indexed by systematic behavioral assessments of undirected motor activity and short attention span in the classroom. EEG and behavioral indices were monitored in four hyperkinetic children under the following six conditions: (1) No Drug, (2) Drug Only, (3) Drug and SMR Training I, (4) Drug and SMR Reversal Training, (5) Drug and SMR Training II, (6) No Drug and SMR Training. All hyperkinetic subjects were maintained on a constant drug regimen throughout the phases employing chemotherapy. Contingent increases and decreases in SMR occurred in three of four training subjects and were associated with similar changes in classroom assessments of motor inactivity. Combining medication and SMR training resulted in substantial improvements that exceeded the effects of drugs alone and were sustained with SMR training after medication was withdrawn. In contrast, these physiological and behavioral changes were absent in one highly distractible subject who failed to acquire the SMR task. Finally, pretraining levels of SMR accurately reflected both the seve-ity of original motor deficits and the susceptibility of hyperkinetic subjects to both treatments. Although the procedure clearly reduced hyperkinetic behavior, a salient, specific therapeutic factor could not be identified due to the dual EEG contingency imposed combined with associated changes in EMG. Despite these and other qualifying factors, the findings suggested the prognostic and diagnostic value of the SMR in the disorder when overactivity rather than distractibility is the predominant behavioral deficit.