The choice of reinforcement quality depending on the delay time of the instrumental reaction in cats]

In experiments on seven cats instrumental delayed reflexes with different quality reinforcement were elaborated by method of "active choice", where the time of delay of the motor reaction served as a signal of quality of the reinforcement. Five cats used a strategy with long delay high-quality reinforcement (meat), and two cats preferred short delay and low-quality reinforcement (bread-meat mixture). In special experiments with the change of alimentary motivation (24-hour alimentary deprivation and saturation of animals) it was established that the level of alimentary motivation within the studied limits did not change the strategy of behaviour preferred by the given animal. Individually varying ability to choice of reaction determining more valuable reinforcement it is possible to consider as an experimental analogue of the mechanisms of will. The question is discussed about the role of typological properties of cats in choice of behaviour strategy.     

The characteristics of the neuronal reactions of the cat somatosensory cortex to a heteromodal complex conditioned signal]

On alert cats the change was studied of the activity of the neurones of the sensorimotor cortical area at instrumental reaction to a simultaneous heteromodal complex stimulus. It was shown that in the projection of distal limb areas a group could be singled out of neurones, which changed their activity in one direction depending on the character of presented signals. In these cells an increase of discharges frequency was observed in response to complex stimulus, consisting of light and sound signals. After the extinction of the motor reaction both to the complex stimulus and to its components neuronal reactions of lesser intensity was recorded, what determined the absence of the motor reaction. This group of neurones had receptive fields localized on distal limb areas, it was activated at fulfillment of the movement of catching the reinforcement and belonged to neurones of the pyramidal tract. The neurones with receptive fields on the whole limb surface or changing their activity at the animal pose change, had variable reactions to positive and differentiation stimuli.     

Complex alimentary motor conditioned reflex reactions in cats and dogs]

The ability of animals to perform a complex motor task representing a model of compensatory discrete tracing was investigated in dogs and cats. Elongation of a light spot on an oscilloscope screen into a vertical line served as a signal of motor reaction. The reaction consisted in several movements, each of which reduced the initial signal change by 1/2, 1/3, 1/4 or 1/5 of its value. Alimentary reinforcement was given only after a reduction of the signal to its initial level. Signals with a different number of steps of transition to their initial state were presented at random. It was found that learned animals were capable of a stable behaviour of a compensatory discrete tracing type. A hypothesis has been advanced about a probabilistic participation of visual control in the realization of tracing motor behaviour.     

Central effects of the tetrapeptide tuftsin

Under systemic administration tuftsin produces a marked influence on behavior and emotional reactivity in rats: enhances motor (vertical) activity, perception of pain stimulation and related aggressiveness and residual excitation. Activating effect is accompanied by an aggravation of the acquisition of passive avoidance reaction during single reinforcement. In vitro experiments revealed a direct inhibitory effect of tuftsin on the reaction rate of brain tyrosine hydroxylase activity. In vivo there was shown an increase in hypothalamic and especially striatal tyrosine hydroxylase activity. The data obtained indicate direct relationships between tuftsin central effects and the changes in brain catecholaminergic processes participating in the regulation of emotional-motivational and motor reactions.     

Time-integrated position error accounts for sensorimotor behavior in time-constrained tasks

Several studies have shown that human motor behavior can be successfully described using optimal control theory, which describes behavior by optimizing the trade-off between the subject's effort and performance. This approach predicts that subjects reach the goal exactly at the final time. However, another strategy might be that subjects try to reach the target position well before the final time to avoid the risk of missing the target. To test this, we have investigated whether minimizing the control effort and maximizing the performance is sufficient to describe human motor behavior in time-constrained motor tasks. In addition to the standard model, we postulate a new model which includes an additional cost criterion which penalizes deviations between the position of the effector and the target throughout the trial, forcing arrival on target before the final time. To investigate which model gives the best fit to the data and to see whether that model is generic, we tested both models in two different tasks where subjects used a joystick to steer a ball on a screen to hit a target (first task) or one of two targets (second task) before a final time. Noise of different amplitudes was superimposed on the ball position to investigate the ability of the models to predict motor behavior for different levels of uncertainty. The results show that a cost function representing only a trade-off between effort and accuracy at the end time is insufficient to describe the observed behavior. The new model correctly predicts that subjects steer the ball to the target position well before the final time is reached, which is in agreement with the observed behavior. This result is consistent for all noise amplitudes and for both tasks.     

Daytime Sleep Enhances Consolidation of the Spatial but Not Motoric Representation of Motor Sequence Memory

Motor sequence learning is known to rely on more than a single process. As the skill develops with practice, two different representations of the sequence are formed: a goal representation built under spatial allocentric coordinates and a movement representation mediated through egocentric motor coordinates. This study aimed to explore the influence of daytime sleep (nap) on consolidation of these two representations. Through the manipulation of an explicit finger sequence learning task and a transfer protocol, we show that both allocentric (spatial) and egocentric (motor) representations of the sequence can be isolated after initial training. Our results also demonstrate that nap favors the emergence of offline gains in performance for the allocentric, but not the egocentric representation, even after accounting for fatigue effects. Furthermore, sleep-dependent gains in performance observed for the allocentric representation are correlated with spindle density during non-rapid eye movement (NREM) sleep of the post-training nap. In contrast, performance on the egocentric representation is only maintained, but not improved, regardless of the sleep/wake condition. These results suggest that motor sequence memory acquisition and consolidation involve distinct mechanisms that rely on sleep (and specifically, spindle) or simple passage of time, depending respectively on whether the sequence is performed under allocentric or egocentric coordinates.     

The neuronal reactions of the cat motor cortex to electrical stimulation of the ventral tegmental area as a conditioned signal for the reflex of placing the forelimb on a support]

Electrical stimulation (50-100 pulses, 100-500 Hz) of the ventral tegmental area (VTA) in the vicinity of the n. interpeduncularis in the frontal plane AP2-AP4, L1-L2 caused a cat to grab food placed near its mouth. The conditioned forepaw placing reaction was elaborated using food reinforcement and VTA stimulation as a conditioned stimulus. The conditioned reflex, being once established, was repeatedly performed without extinction in the course of up to 250 trials without food reinforcement. Short (5-10 pulses) conditioned VTA stimulation evoked a prolonged (up to 1000 ms or longer) activation of neurons of the motor cortex and caused a substitution of the inhibitory phase of response to stimulation of the parietal cortex in poststimulus interval in 50-200 ms for the late secondary excitatory response.     

Possible mechanisms of the divergent effects of ACTH4--10 and its analog containing the D-isomer of phenylalanine on behavior

The effect of two oligopeptides--ACTG4-10 and hexopeptide met-glu-his-D-phen-lis-L-phen (Dphen-GP) on memorizing the situation and on orienting-investigating reaction was studied in albino rats by the method of elaboration of food-procuring habit in T-maze and by the method of "open field". It was shown that these peptides in a dose of 15 mcg/kg with certain periods of administration, have an opposite effect on maze learning but a similar effect on memorizing in the "open field". ACTG4-10 slightly increases motor activity in the "open field", whereas Dphen-GP decreases it considerably. It is suggested that ACTG4-10 improves the formation of trace processes independently of the sign of reinforcement, whereas Dphen-GP selectively enhances defensive reaction and memorizing, connected with negative reinforcement.     

Disruption of food-getting movements after removal of the motor or premotor zone of the cerebral cortex in cats]

Instrumental food-procuring movements were studied in cats before and after unilateral or bilateral ablation of the motor or premotor cortical area. It is shown that unilateral impairment of the motor area affects the strength and accuracy of movements of the contralateral fore-leg, whereas the ablation of the premotor area leads to a slowing down of movements and breaking of a goal-directed movement into separate components. Bilataral ablation of the motor area irreversibly abolished the instrumental reflex. The ablation of the premotor cortex destroyed the animal's reaction to the sound signal, but food-procuring movements of the fore-legs were disturbed only temporarily. The obtained data are discussed on the basis of the concept that in cats the above cortical areas play different roles in the organization of goal directed behaviour.     

Stimulus magnitude effects on the extinction of conditioned consummatory responses to flavored sucrose solution in mice

Paradoxical extinction effects in the conditioned consummatory behavior of rodents have remained largely elusive. Here, appetitive flavor conditioning was studied to determine if a paradoxical magnitude of reinforcement extinction effect (MREE) can occur in the consummatory behavior of mice. During acquisition training of two experiments with factorial design, animals received daily access to either 32% or 4% sucrose solution, and goal tracking time was measured in one-minute bins. In Experiment 1 the solutions were flavored with either 5% or 0.5% almond essence and in Experiment 2 with 2% almond essence, but combined with continuous or partial schedules of reinforcement. During extinction tests of Experiment 1 and 2, water flavored with 0.5% or 2% almond was presented, respectively. Consummatory performance decreased more abruptly during the initial portion of the extinction sessions after training with 32% as compared to 4% sucrose solution. Furthermore, when given a choice test after extinction training (Experiment 2), animals trained with 32% sucrose, preferred the flavored solution, but animals trained with 4% preferred the unflavored solution. These results are interpreted as indicative of the occurrence of a paradoxical MREE in conditioned consummatory behaviors.     

Activity of neurons of the motor zone of the cortex during elaboration of a local instrumental defensive reflex in the rabbit

During instrumental defensive reaction of wrist extension in response to a sound (conditioned) stimulus, two types of neuronal responses in the rabbit motor cortex were discovered. The first type was recorded in cells with activity not connected with electromyographic activity of wrist extensors. The reaction consisted in the appearance of inhibitory response at the place of the cancelled electrocutaneous stimulation at animal's performance of conditioned reaction to sound. The second type of responses was shown for a neurone with the activity significantly related to electromyographic activity. In this case the conditioned motor response was accompanied by enhancement of the cellular activation reaction to sound and the increase of spike activity in interstimuli intervals.     

Operant control of human eye movements

Saccade and smooth pursuit are the eye movements used by primates to shift gaze. In this article we review evidence for the effects of reinforcement on several dimensions of these responses such as their latencies, velocities or amplitudes. We propose that these responses are operant behaviours controlled by their consequences on performance of visually guided tasks. Studying the conditions under which particular eye movement patterns might emerge from the cumulative effects of reinforcement provides critical insights about how motor responses are attuned to environmental exigencies.     

Activity of pre-entral neurones in conscious monkeys: effects of deafferentation and cerebellar ablation.

After limb deafferentation, there was no gross alteration in the initiation and performance of a sound-triggered ballistic movement. The pattern of neuronal discharge in the arm area of the motor cortex was not significantly modified. In the absence of cerebellum, the reaction time of motor cortex cells was about 150 msec longer than the reaction time observed in normal and deafferented animals. This was associated with an equal retardation in the onset of ENG changes in the limb muscles. This observation is compatible with the idea that the motor cortex is normally situated downstream to the cerebellum in the initiation of some movements. However, the motor cortex is necessary for the initiation and execution of simple sound-triggered movements since its removal results in a permanent inability to perform the task. Finally, in the absence of peripheral feedback, the pattern of motor output to the agonistic and antagonistic muscles was initiated normally and thus appeared to be preprogrammed centrally. The importance of the motor cortex as a "reflex center" in the control of slower movements is obviously not challenged by these observations since the motor task that we have used depends very little or not at all on sensory feedback (Stark, 1968). What these results indicate, however, is that the execution of some voluntary fast ballistic movements can be entirely preprogrammed independently of peripheral and cerebellar influences, and that the program, which is mainly concerned with generating velocity signals, appears to require the integrity of the motor cortex for its execution.     

Performance correlates of social behavior and organization: Social rank and omission of reinforcement in rhesus monkeys (M. mulatta)

The performance of 22 adult male rhesus monkeys on a Fixed Interval 1-min reinforcement schedule was examined under conditions where the reinforcement probabilities were either 1.00 or .80. The results were then related to the social rank of animals at the time that they were taken from their social groups. Both high and low ranked animals reached criterion performance in the same number of trials. In general, high ranking animals responded at lower rates than low ranking animals when the reinforcement probability was 1.00. When the reinforcement probability was shifted to .80, all animals showed an increase in responding after nonreinforced intervals as compared with responses after reinforced intervals. The higher ranked animals tended to have a higher ratio of nonreinforced to reinforced responses than lower ranked animals. Supported by USAMRDC Contract No. DADA 17-73-C-3007.     

Electrophysiological correlates of local muscular fatigue effects upon human visual reaction time.

A study of the neurophysiological basis of reaction time change was undertaken as a means of exploring the physiological mechanisms of local muscular fatigue effects upon sensorimotor performance. The identification of electrophysiological indices of central and peripheral processes within the human electroencephalogram and electromyogram, enabled a fractionation of total reaction time into component latencies measuring sensory reception time, sensorimotor integration time, central motor outflow time and peripheral motor contraction time. Simple foot dorsiflexion reactions to visual stimuli were observed in 18 male college students. Foot responses under one condition were performed against a resistance which necessitated a moderate degree of muscular tension before movement could occur while a second condition required normal unresisted responses. Two intensities of serial isometric work resulting in the order of a 38% decrement in maximum voluntary contractile capability (MVC) were performed by each subject. While the rate and extent of MVC decrement varied with the inherent strength of the subject and the intensity of the exercise performed, unconditional changes were observed in the spatiotemporal dimensions of reaction time performance following exercise-induced fatigue. The quality of total reaction time was found to deteriorate, particularly when responses were resisted. Peripheral deficiencies, suggestive of a decreased rate of tension development, were evidenced by a marked elongation of resisted motor times, and less vigorous and extensive unresisted responses. Insofar as the energy of response electromyograms was also diminished, central mechanisms were implicated, possible due to a shift in motor unit recruitment. Concomitant changes were also observed in central processing.     

Influence of the probability of the random performance of an acquired reaction on the rate of the formation of an instrumental reflex

Instrumental reflex formation in rats takes place more rapidly at high probability of random performance of instrumental reaction to light; however, it does not depend on the frequency of correct responses positive reinforcements (from 50 to 100%). In case of low probability, the learning process sharply slows down at 50% reinforcement of correct responses in comparison with 100% one.     

Activity of neurons in the pedunculopontine nucleus in conditioned instrumental appetitive reflex

Activity of 91 neurons in the compact and diffuse parts of the pedunculopontine tegmental nucleus (PPTg) was recorded in freely moving rabbits during execution of instrumental appetitive conditioning. Of the recorded neurons, 37.4% changed their activity in response to a conditioned stimulus, which is the evidence for the PPTg involvement in instrumental conditioning. Excitatory conditioned neuronal responses to the conditioned stimulus and food reinforcement significantly prevailed over inhibitory reactions. Neuronal responses to the conditioned stimulus were classified in several basic patterns reflecting stimulus effects, structure of the behavioral act, and reinforcement properties. These reactions indicate the involvement of the PPTg in attention, motor learning, and reinforcement. The revealed differences in associative reactive properties of the compact and diffuse parts of the PPTg to the conditioned stimulus and reinforcement point to the functional heterogeneity of this structure and suggest the leading role of the cholinergic part of the PPTg in instrumental appetitive conditioning and reinforcement as well as the essential contribution of the diffuse part into classical appetitive conditioning.     

The dependence of hippocampal electrical activity on the probability of the reinforcement of a conditioned food stimulus

In three dogs the dynamics was studied of changes in the number of instrumental motor reactions, the heart rate and the hippocampus theta rhythm was studied at the change of constant reinforcement to various regimes of probable reinforcement of alimentary conditioned stimulus. At 70 and 50% levels of the reinforcement the instrumental reflex appeared in response to all presentations of the signal stimulus. The greatest decrease in the number of reactions took place at 5% probability. The heart rate both in the intersignal period and at getting of empty feeder depended on the used probability of reinforcement and individual characteristics of animals. The frequency of the theta rhythm in all dogs was the highest at the 30% level and the lowest values were found at the 5% level of reinforcement. The obtained facts testify once more to complex genesis of emotional excitation, the value of which depends both on informational (uncertainty) and motivational (significance of reinforcement) factors.     

Functional asymmetry of the frontal cortex and lateral hypothalamus of cats during food instrumental conditioning

The synchronism and latency of auditory evoked potentials (EP) recorded in symmetric points of the frontal cortex and lateral hypothalamus of cats were measured at different stages of instrumental food conditioning and after the urgent transition to 30% reinforcement. Correlation coefficients between EPs in the cortex and hypothalamus were high (with left-side dominance) at the beginning of the experiments, when food motivation was high, and during the whole experiments in cases of high-probability of conditioned performance. Analysis of early positive P55-80 EP component showed that at all conditioning stages the peak latency of this component was shorter in the left cortical areas than in symmetrical points, whereas in the hypothalamus the shorter latency at the left side was observed at the stage of unstable conditioned reflex, and at the stage of stable reflex the latency of the studied component was shorter at the right side. During transition to 30% reinforcement, the latency was also shorter in the right hypothalamus. It is suggested that the high left-side correlation between the hypothalamus and cortex was associated with motivational and motor component of behavior rather than reflected the emotional stress induced by transition to another stereotype of food reinforcement (30%).     

Strength training for 1h in humans: effect on the motor performance of normal upper extremities

It has been found that one session of intense muscle strength training decreases muscle strength temporarily and causes neuromuscular fatigue in the trained muscles, but little attention has been given to the effects of neuromuscular fatigue on the other components of motor performance. The purpose of this study was to examine in normal healthy volunteers the effects of a 1-h strength training session on the motor performance of the upper extremity, including reaction time, speed of movement, tapping speed and coordination. Group of 30 healthy female volunteers, aged 29-47 years, were randomly divided into sub-groups, (A and B, n = 15 per group). Both groups first completed a set of motor performance tests on 3 consecutive days. On the 4th day, group A carried out a 1-h muscle strength training session of the upper extremities. Isometric muscle strengths and electromyogram (EMG) data were recorded before the training session. Immediately after the training session the same recordings were repeated, and additional motor performance tests were also performed. Group B carried out only the motor performance tests. The groups exchanged programmes the following week. The 1-h strength training session decreased the isometric muscle strength of wrist flexion by 18% (P < 0.001) and extension by 18% (P < 0.001) in group A, while in group B flexion strength decreased by 19% (P < 0.001) and extension strength by 17% (P < 0.001). All the measured EMG activations also decreased in both groups. There were no statistically significant differences in the results of the motor performance tests between the mean values of the three baseline measurements and the values recorded after the training session. The result was surprising, but straightforward; neuromuscular fatigue induced by a 1-h strength training session of the upper extremities had no effect on the motor performance functions of the hand, as indicated by reaction times, speed of movement, tapping speed and coordination, in these normal healthy female volunteers.