Operant conditioning of EEG rhythms and ritalin in the treatment of hyperkinesis

Enhanced voluntary motor inhibition regularly accompanies conditioned increases in the sensorimotor rhythm (SMR), a 12–14-Hz Rolandic EEG rhythm in cats. A similar rhythm, presumably SMR, has also been identified in the human EEG. The clinical effectiveness of SMR operant conditioning has been claimed for epilepsy, insomnia, and hyperkinesis concurrent with seizure disorders. The present report attempts to follow up and replicate preliminary findings that suggested the technique's successful application to hyperkinesis uncomplicated by a history of epilepsy. SMR was defined as 12–14-Hz EEG activity in the absence of high-voltage slow-wave activity between 4 and 7 Hz. Anticipated treatment effects were indexed by systematic behavioral assessments of undirected motor activity and short attention span in the classroom. EEG and behavioral indices were monitored in four hyperkinetic children under the following six conditions: (1) No Drug, (2) Drug Only, (3) Drug and SMR Training I, (4) Drug and SMR Reversal Training, (5) Drug and SMR Training II, (6) No Drug and SMR Training. All hyperkinetic subjects were maintained on a constant drug regimen throughout the phases employing chemotherapy. Contingent increases and decreases in SMR occurred in three of four training subjects and were associated with similar changes in classroom assessments of motor inactivity. Combining medication and SMR training resulted in substantial improvements that exceeded the effects of drugs alone and were sustained with SMR training after medication was withdrawn. In contrast, these physiological and behavioral changes were absent in one highly distractible subject who failed to acquire the SMR task. Finally, pretraining levels of SMR accurately reflected both the severity of original motor deficits and the susceptibility of hyperkinetic subjects to both treatments. Although the procedure clearly reduced hyperkinetic behavior, a salient, specific therapeutic factor could not be identified due to the dual EEG contingency imposed combined with associated changes in EMG. Despite these and other qualifying factors, the findings suggested the prognostic and diagnostic value of the SMR in the disorder when overactivity rather than distractibility is the predominant behavioral deficit.     

Operant conditioning in the ant Myrmica sabuleti

Operant conditioning could be obtained in the ant Myrmica sabuleti by presenting to the workers, during a six-day period, an apparatus containing either sugared water or meat as a reward. The conditioning obtained using sugared water as a reward was short lasting. A reconditioning was more persistent and lasted four hours. The ants' response was very precise, since they exhibited it only in front of an apparatus identical to that used during the training phase. Operant conditioning obtained using meat as a reward was more pronounced than that obtained by using sugared water, probably because meat is more valuable as a reward than sugar for the species studied, which is essentially a carnivorous one. Such a conditioning was rather persistent. Indeed, a first operant conditioning obtained by using meat as a reward could still be detected after seven hours, and a reconditioning was still significant after eight hours. One day after this eight-hour period without rewarding the ants, the response was higher again and a further day later, it was still significant. Since the operant conditioning is easy to perform and quantify and since the ants' response is very precise, such a conditioning can be used for further studying M. sabuleti workers' visual perception.     

Operant conditioning of scratching in lemurs

An adult femaleLemur catta and an adult femaleEulemur fulvus were given edible rewards for scratching. Both subjects learned to scratch in order to obtain the rewards, showed diminished rates of scratching during periods of extinction, and learned to scratch preferentially with one foot when required. TheLemur catta subject was more responsive to the changing experimental conditions than theEulemur fulvus. The conditionability of scratching in primates does not appear to be directly related to the widespread occurrence of scratching in simian social contexts.     

Operant conditioning of skin resistance tonic levels

The purpose of the current investigation was to determine whether increases and decreases in skin resistance tonic level could be controlled by individuals given discrete visual feedback of such activity. Thirty-six male undergraduate students served as subjects. They were assigned randomly in equal numbers to four groups; two of the groups received accurate feedback of skin resistance level changes and two received inaccurate feedback. The two accurate-feedback groups differed with respect to the order in which increases and decreases in skin resistance level were reinforced. Each noncontingent group was matched with one of the contingent groups in terms of reinforcement density. The results indicated that accurate feedback produced skin resistance level changes consistent with the type of reinforcement employed. However, operant control was not clearly sustained subsequent to a reversal in the type of tonic level change reinforced. Some problems related to the clinical application of skin resistance level training are discussed.     

Operant conditioning of skin resistance tonic levels

The purpose of the current investigation was to determine whether increases and decreases in skin resistance tonic level could be controlled by individuals given discrete visual feedback of such activity. Thirty-six male undergraduate students served as subjects. They were assigned randomly in equal numbers to four groups; two of the groups received accurate feedback of skin resistance level changes and two received inaccurate feedback. The two accurate-feedback groups differed with respect to the order in which increases and decreases in skin resistance level were reinforced. Each noncontingent group was matched with one of the contingent groups in terms of reinforcement density. The results indicated that accurate feedback produced skin resistance level changes consistent with the type of reinforcement employed. However, operant control was not clearly sustained subsequent to a reversal in the type of tonic level change reinforced. Some problems related to the clinical application of skin resistance level training are discussed.Portions of this paper were presented at the meeting of the Midwestern Psychological Association, Chicago, 1973.     

Operant conditioning of brain steady potential shifts in man

Steady potential shifts (SPS) recorded from the scalp were conditioned operantly by visual and acoustical feedback. Three groups of seven subjects were each tested with a different response-reinforcement contingency: positive reinforcement for a positive SPS after a cue stimulus, positive reinforcement for a negative SPS after a cue stimulus, and noncontingent reinforcement. The steady potential shifts learned under these three conditions differed significantly. Negative shifts were associated with subjective feelings of activation, positive shifts with inactivation. Cortical genesis and possible artifacts are discussed.This research was supported by a grant from theFond zur Förderung der wissenschaftlichen Forschung.     

Ultradian rhythms in the EEG and task performance

The purpose of this work was to investigate the presence of ultradian rhythms in: 1. levels of electroencephalographic activation; 2. interhemispheric correlation and 3. the performance of two cognitive tasks, and the correlation between these variables. Eight volunteers, aged 20 to 30, participated in the experiment. Two sessions were carried out: one from 0800 to 1400 on one day and the other from 1400 to 2000 another day. Samples of EEG activity were taken every 15 min at rest with eyes open in left and right temporal, central, parietal and occipital derivations referred to the ipsilateral earlobe the performance on two tasks, one logico-analytical (left hemisphere functions) and one spatial test (right hemisphere functions) was assessed. As control, body and environmental temperature were recorded. To test for the presence of ultradian rhythms, the data were subjected to a Fourier analysis. Different EEG variables showed rhythmicity throughout the sessions, principally with slow oscillation periods (3 and 6h); ultradian rhythms with 3h periods were also found in body temperature, while task performance showed no significant rhythmic patterns during sessions. Finally, no significant correlations were found between physiological variables evaluated and task performance.     

Operant conditioning of cortical steady potential responses in rats

This study was conducted to determine if amplitudes of rat corticol steady potential (SP) response to an auditory stimulus could be altered by operant conditioning procedures using food reinforcement. The negative SP responses to the 5-sec tone alone diminished with repeated presentation of the stimulus. When food reinforcement was given immediately following the tone, SP response amplitudes increased and stabilized after 4–5 sessions. Thereafter, the animals were required to increase or decrease the amplitudes of response in order to obtain reinforcement. Two of three rats required to increase amplitudes were successful and three of four rats required to decrease amplitudes were successful. It is concluded that changes in cortical SP responses can be operantly conditioned.     

Operant conditioning of small birds for acoustic discrimination

Standard operant conditioning techniques have been successfully applied to the problem of call discrimination in small birds. Budgerigars (Melopsittacus undulatus) and canaries (Serinus canarius) were trained with a GO/NOGO procedure using positive reinforcement to discriminate between both conspecific contact calls and contact calls of the other species. Budgerigars showed equal facility at each task. By contrast, canaries learned the task involving conspecific contact calls but failed, as a group, to discriminate between budgerigar contact calls. These results show that conditioning techniques can be used to study perceptual learning of species typical calls in small birds.     

Operant conditioning and behavioral analyses using a minicomputer.

An operant conditioning and data analysis software system was developed for use on a PDP-12A minicomputer. The operant software functions in quasi time-sharing fashion to control and acquire data from any peripheral device that operates in the binary mode. In addition to independently running different experiments in near simultaneous fashion, the program also provides information on the current status of each experiment using a cathode ray-tube display. Response data from each experimental subject is stored on magnetic tape and analyzed, off-line, by the data analysis portion of the software system. A discussion of the operation of this system is given for one possible application: visual discrimination training.     

Operant control of EEG and event-related and slow brain potentials

Research on operant control of brain potentials is reviewed. From single-unit firing and spontaneous EEG activity to event-related potentials such as sensory and pain evoked potentials, and slow potential shifts, most of the aspects of electrical brain activity have been investigated. Results produced by conditioning of spontaneous EEG oscillations (alpha and theta) dampened the early enthusiasm: e.g., no increase above baseline levels could be achieved and no reliable behavioral effects became manifest. Evidence accumulates, however, that operant conditioning of the sensorimotor rhythm (12–15 Hz) may lead to successful self-regulation and that epileptic patients may profit from the training. First steps in the conditioning of brainstem, as well as pain evoked potentials suggest that self-regulation of EPs can be achieved by adequate biofeedback procedures. If some of the observed behavioral effects prove to be stable, the therapeutic usefulness seems to be within reach. A comparable progress has been achieved for the operant control of slow potentials (DC-shifts across seconds). Biofeedback procedures have been used successfully as a scientific tool to achieve systematic variations on a psychological level and to record psychological covariations. This method may provide insights into the behavioral meaning of electrical brain activity.     

Operant conditioning of brain steady potential shifts in man.

Steady potential shifts (SPS) recorded from the scalp were conditioned operantly by visual and acoustical feedback. Three groups of seven subjects were each tested with a different response-reinforcement contingency: positive reinforcement for a positive SPS after a cue stimulus, positive reinforcement for a negative SPS after a cue stimulus, and noncontingent reinforcement. The steady potential shifts learned under these three conditions differed significantly. Negative shifts were associated with subjective feelings of activation, positive shifts with inactivation. Cortical genesis and possible artifacts are discussed.     

Changes in EEG rhythms during verbal and visual-image thinking

General and local characteristics of EEG activation were studied in frontal, central, temporal and occipital areas of the left and right cerebral hemispheres in 20 adult subjects during execution of various mental tasks. The analysis of the changes of five main EEG rhythms (delta, theta, alpha, beta-1 and beta-2) showed that EEG power decrease in alpha- and beta-frequency ranges is a reliable and sensitive index of brain activation at thinking. On this basis EEG activation mosaics are described at carrying out of each task and its systemic changes at transition from one type of task to another one, depending on their psychological structure--modality and complexity.     

Operant conditioning of rat navigation using electrical stimulation for directional cues and rewards

Operant conditioning is often used to train a desired behavior in an animal. The contingency between a specific behavior and a reward is required for successful training. Here, we compared the effectiveness of two different mazes for training turning behaviors in response to directional cues in Sprague-Dawley rats. Forty-three rats were implanted with electrodes into the medial forebrain bundle and the left and right somatosensory cortices for reward and cues. Among them, thirteen rats discriminated between the left and right somatosensory stimulations to obtain rewards. They were trained to learn ipsilateral turning response to the stimulation of the left or right somatosensory cortex in either the T-maze (Group T) or the maze (Group W). Performance was measured by the navigation speed in the mazes. Performances of rats in Group T were enhanced faster than those in Group W. A significant correlation between performances during training and performance in final testing was observed in Group T starting with the fifth training session while such a correlation was not observed in Group W until the tenth training session. The training mazes did not however affect the performances in the final test. These results suggest that a simple maze is better than a complicated maze for training animals to learn directions and direct cortical stimulation can be used as a cue for direction training.     

Operant conditioning of antennal muscle activity in the honey bee (Apis mellifera L.)

Antennal movements of the honey bee can be conditioned operantly under laboratory conditions. Using this behavioural paradigm we have developed a preparation in which the activity of a single antennal muscle has been operantly conditioned. This muscle, the fast flagellum flexor muscle, is innervated by an identified motoneuron whose action potentials correlate 1:1 with the muscle potentials. The activity of the fast flagellum flexor muscle was recorded extracellularly from the scapus of the antenna. The animal was rewarded with a drop of sucrose solution whenever the muscle activity exceeded a defined reward threshold. The reward threshold was one standard deviation above the mean spontaneous frequency prior to conditioning. After ten conditioning trials, the frequency of the muscle potentials had increased significantly compared to the spontaneous frequency. The conditioned changes of frequency were observed for 30 min after conditioning. No significant changes of the frequency were found in the yoke control group. The firing pattern of the muscle potentials did not change significantly after conditioning or feeding. Fixing the antennal joints reduces or abolishes associative operant conditioning. The conditioned changes of the frequency of muscle potentials in the freely moving antenna are directly comparable to the behavioural changes during operant conditioning. Accepted: 29 March 2000