Self-Initiated Motor Behavioral Act-Related Neuronal Activity in the Cat Locus Coeruleus

In experiments on awake cats, we recorded the activity of 61 putative noradrenergic neurons localized within the region of the locus coeruleus (LC) of the brainstem. The animals were trained to perform a self-initiated (voluntary) motor act aimed at obtaining a food reward by pushing a pedal by the forelimb. The intervals between pushings (stay of the limb on a platform before initiation of the movement) should not be shorter than 4 sec, and the duration of the movement itself should not exceed 1 sec. The following impulse reactions were most clearly manifested (i) related to the pre-starting events and performance of the voluntary movement, (ii) related to the presentations of the conditioning stimuli, which predicted giving out the food reward (a positive signal) or the absence of the latter (a negative signal) and (iii) related to the reward presentation. About 50% of the LC units under study had changed their activities before the movement was initiated. These reactions can be related to a cognitive component (determination of the movement initiation(, which is present in the experimental task. Most neurons responded by phasic activation to presentation of the conditioning signals, and this activation was more pronounced in the case of negative signals. Responses of the studied nerve cells are probably indicative of the involvement of the LC neuronal systems in the perception of the emotiogenic stimuli, as well as in the processes providing the maintenance of selective attention within different stages of targeted behavioral acts.     

Activity of the parietal associative cortex neurons and aminergic brainstem neurons at the performance of a voluntary movement in cats

Activity of 98 neurons of the parietal associative cortex (PAC) and 189 supposedly aminergic brainstem neurons (dopaminergic in thesubstantia nigra pans compacta, noradrenergic in thelocus coeruleus region, and serotonergic in theraphe nuclei) was recorded in awake cats. The animals were trained to perform a voluntary movement (pressing a pedal) not earlier than at a certain prefixed time moment. More than half of the recorded units modified their activity before the movement initiation. The PAC neurons responded mostly within the interval of planning of the movement, while reactions of aminergic neurons were observed in the course of its initiation, which probably provides facilitation of the responses of cortical neurons. The pattern of responses was rather specific for each of the studied neuronal populations.     

Activity of the neostriatum neurons in monkeys during operant behavior

Monkeys (Macaca nemestrina) were trained to perform an operant task which included the following stages: bimanual movement to a visible target in response to a start signal, selection of the left or right operating hand according to the visual conditioning signal, careful movement of the selected hand, movements of fingers of the same hand, and taking of a reward. The spike activity was recorded simultaneously from five or six neurons in the caudate nucleus (Cd) head. Most of the Cd neurons were activated during the taking of a reward, the analysis of conditioning signals, and visually controlled movements. It has been found that the same neuron of the Cd may be activated in different ways during different components of the behavioral program, depending on the complexity of the conditioning signals and the correct versus incorrect selection of an operating hand. It is concluded that the Cd neurons have no functional specialization and that they take part in mechanisms preceding a movement or accompanying it, but not correlating with the form of its realization.Translated from Neirofiziologiya, Vol. 25, No. 2, pp. 132–140, March–April, 1993.     

Physiological properties and response modulations of mushroom body feedback neurons during olfactory learning in the honeybee, Apis mellifera

Mushroom bodies are central brain structures and essentially involved in insect olfactory learning. Within the mushroom bodies γ-aminobutyric acid (GABA)-immunoreactive feedback neurons are the most prominent neuron group. The plasticity of inhibitory neural activity within the mushroom body was investigated by analyzing modulations of odor responses of feedback neurons during olfactory learning in vivo. In the honeybee, Apis mellifera, feedback neurons were intracellularly recorded at their neurites. They produced complex patterns of action potentials without experimental stimulation. Summating postsynaptic potentials indicate that their synaptic input region lies within the lobes. Odor and antennal sucrose stimuli evoked excitatory phasic-tonic responses. Individual neurons responded to various odors; responses of different neurons to the same odor were highly variable. Response modulations were determined by comparing odor responses of feedback neurons before and after one-trial olfactory conditioning or sensitisation. Shortly after pairing an odor stimulus with a sucrose reward, odor-induced spike activity of feedback neurons decreased. Repeated odor stimulations alone, equally spaced as in the conditioning experiment, did not affect the odor-induced excitation. A single sensitisation trial also did not alter odor responses. These findings indicate that the level of odor-induced inhibition within the mushroom bodies is specifically modulated by experience. Accepted: 9 September 1999     

Effect of response inhibition in cat motor cortex neurons during the expectation of conditioning stimulus

The spike responses of the motor cortex neurons (area 4) associated with forelimb movement were studied in awake cats earlier trained to perform placing motor reactions. Responses produced by the same neurons were compared in two situations: 1) when a sound-click conditioning stimulus (CS) was applied in isolation; 2) when a CS followed a preliminary warning stimulus (WS), a light flash, with a 100–1000 msec delay. During the reflex initiation by combined action of the WS and CS, response components that occurred prior to the placing movement (PM) performance under isolated CS action weakened and arrived 50–150 msec later; yet, response components that appeared in the same situation simultaneously with PM onset or later remained unchanged. PM latent periods were not changed when WS was applied. The temporal interval between WS and CS was characterized by depression of neuronal activity; depression duration was determined by the interstimulus delay. It is conceivable that the described transformations in spike responses of cortical neurons occurred due to changes in the sensory direction of the animal's attention; this direction, in all cases, is a crucial factor in the formation of neuronal activity in the cortex.Translated from Neirofiziologiya, Vol. 25, No. 1, pp. 21–27, January–February, 1993.t     

Role of Acetylcholine in the Modulation of Activity of Neocortical Neurons in Awake Animals Performing an Instrumental Conditioned Reflex

We studied modulatory effects of the cholinergic system on the activity of sensorimotor cortex neurons related to realization of an instrumental conditioned placing reflex. Experiments were carried out on awake cats; multibarrel glass microelectrodes were used for extracellular recording of impulse activity of neurons in the sensorimotor cortex and iontophoretic application of synaptically active agents within the recording region. The background and reflex-related activity was recorded in the course of realization of conditioned movements, and then changes of spiking induced by applications of the testing substances were examined. Applications of acetylcholine and carbachol resulted in increases in the intensity of impulse reactions of neocortical neurons evoked by presentation of an acoustic signal and in simultaneous shortening of the response latencies. An agonist of muscarinic receptors, pylocarpine, exerted a similar effect on the evoked activity of sensorimotor cortex neurons. Blockers of muscarinic receptors, atropine and scopolamine, vice versa, sharply suppressed impulse reactions of cortical neurons to afferent stimulation and simultaneously increased latencies of these responses. Applications of an agonist of nicotinic receptors, nicotine, was accompanied by suppression of impulse neuronal responses, an increase in the latency of spike reactions to presentation of a sound signal, and a corresponding increase in the latency of a conditioned motor reaction. In contrast, application of an antagonist of nicotinic receptors, tubocurarine, significantly intensified neuronal spike responses and shortened their latency. The mechanisms underlying the effects of antagonists of membrane muscarinic and nicotinic cholinoreceptors and the role of activation of these receptors in the modulation of activity of pyramidal and non-pyramidal neocortical neurons related to realization of the instrumental motor reflex are discussed.     

Thermostimulation-Induced Modulation of Conditioned Reflex Movement-Related Reactions of Cortical Neurons of the Cat

In awake cats trained to perform a food-procuring conditioned operant reflex (placing movement), we studied impulse reactions of 86 neurons of the motor cortex (field 4) related to realization of the above movements. As conditioning stimuli (CS) initiating the reflex, we used either non-noxious electrocutaneous stimulation (ECS) of the contralateral forelimb or an acoustic stimulus (sound click). Impulsation of cortical neurons was recorded under conditions of (i) isolated presentation of the CS (control), (ii) presentation of the CS (either ECS or acoustic stimulus) combined with thermostimulation (heating with a miniature electric bulb) of the skin of the working forelimb, and (iii) the same, but with stimulation of the resting forelimb. When we recorded spike activity of neurons within the projection motor zone of the resting limb subjected to ESC, alternating thermostimulation of both forelimbs resulted in considerable intensification and an increase in the duration of neuronal responses, especially in cases where thermostimulation was applied to the working limb ipsilateral to the recording site (a two- to threefold increase). When spike reactions were recorded within the motor cortex of the working forelimb, thermostimulation resulted in a considerable increase in the intensity of these reactions and a decrease in their latency, but only when such stimulation was applied to the working forelimb. Thermostimulation of the resting (ipsilateral, subjected to ESC) limb evoked opposite effects (the intensity of neuronal reactions dropped). In both situations, placing movements remained within the control limits. When sound click was used as a distant CS, thermostimulation of the working limb enhanced neuronal responses, increased their duration by 50-100%, and also increased the time of forestalling of the movement initiation by spike neuronal reactions. Thermostimulation of the resting forelimb in this situation also suppressed neuronal reactions. We conclude that foreign stimulations directed toward modifications of the receptor model of the operant reflex experimental situation formed in the animal result in a decrease in the intensity of the spike responses of field-4 neurons and prolongation of the latencies of these responses, while stimulations promoting the inflow of afferent information to the cortical projection of the working limb evoke opposite effects, an increase in the intensity of neuronal spike responses and a decrease in their latencies.     

Neuronal reactions in the reticular nucleus of the thalamus upon realization of conditioned placing and its differential inhibition

Cats were trained to perform conditioned forepaw placing (CFP) using food reinforcement. Reactions of 33 neurons were recorded extracellularly in the reticular nucleus (RN) of the thalamus; among these neurons, 24 units were localized in the sensorimotor part of the nucleus. We used short acoustic signals as conditioning positive and differential (negative) stimuli (PS and DS, respectively). When CFP was realized, 21 neurons of the RN sensorimotor part generated late long-lasting activating or inhibitory spike reactions (durations up to 6 sec and 2 sec, respectively); in 3 neurons there were no reactions. Under conditions of differential inhibition, such reactions were not observed, while the background impulse activity became clearly suppressed. In two-thirds of the neurons under study, alternating PS and DS presentations led to suppression of the reactions to PS presentation. We suppose that differential inhibition-related suppression of the background activity and of the spike reactions related to CFP realization result from restriction of the input synaptic volleys to the RN neurons.     

Neuronal reactions in field 2 of the frontal cortex, related to organization and performance of food-procuring movements in rats

Movement-related electrical reactions of neuronal units localized in field 2 of the frontal cortex were studied in albino rats performing fast food-procuring movements under conditions of unrestrained behavior. According to the temporal characteristics of the changes in the neuronal spike activity, three types of reactions were classified: (i) activation that forestalled the movement initiation for 1.0–1.5 sec; (ii) activation or inhibition forestalling this beginning for 0.20–0.26 sec; and (iii) activation in the course of a performed movement. Considerations about the involvement of the neurons of various cortical layers in the mechanisms of programing, switching on, and current control of the efficiency of performance of food-procuring movements are proposed, and the role of the frontal cortex in these processes is discussed.     

Conjunctive processing of locomotor signals by the ventral tegmental area neuronal population

The ventral tegmental area (VTA) plays an essential role in reward and motivation. How the dopamine (DA) and non-DA neurons in the VTA engage in motivation-based locomotor behaviors is not well understood. We recorded activity of putative DA and non-DA neurons simultaneously in the VTA of awake mice engaged in motivated voluntary movements such as wheel running. Our results revealed that VTA non-DA neurons exhibited significant rhythmic activity that was correlated with the animal's running rhythms. Activity of putative DA neurons also correlated with the movement behavior, but to a lesser degree. More importantly, putative DA neurons exhibited significant burst activation at both onset and offset of voluntary movements. These findings suggest that VTA DA and non-DA neurons conjunctively process locomotor-related motivational signals that are associated with movement initiation, maintenance and termination.     

Automated Food-Procuring Movement-Related Neuronal Activity in the Basolateral Amygdala of the Rat

We studied the impulse activity of neurons of the basal and lateral amygdalar nuclei generated when experimental animals (rats) performed fast stereotyped food-procuring movements by the forelimb. Within the basolateral amygdala, there are neurons whose activity is related to different stages of getting off the food, and according to the characteristics of their spiking these neurons should be divided into a number of subpopulations. Activation forestalling the movement initiation by 0.5-1.0 sec was observed in most neurons of the basolateral amygdala; this is considered a manifestation of excitation related to a motivation component of the food-procuring behavior. Activation of amygdalar neurons following movement initiation can result from generation in this structure of additional excitation necessary for successful performance of a complete food-procuring motor cycle.     

Temporal difference models and reward-related learning in the human brain

Temporal difference learning has been proposed as a model for Pavlovian conditioning, in which an animal learns to predict delivery of reward following presentation of a conditioned stimulus (CS). A key component of this model is a prediction error signal, which, before learning, responds at the time of presentation of reward but, after learning, shifts its response to the time of onset of the CS. In order to test for regions manifesting this signal profile, subjects were scanned using event-related fMRI while undergoing appetitive conditioning with a pleasant taste reward. Regression analyses revealed that responses in ventral striatum and orbitofrontal cortex were significantly correlated with this error signal, suggesting that, during appetitive conditioning, computations described by temporal difference learning are expressed in the human brain.     

The Time Course of Corticospinal Excitability during a Simple Reaction Time Task

The production of movement in a simple reaction time task can be separated into two time periods: the foreperiod, which is thought to include preparatory processes, and the reaction time interval, which includes initiation processes. To better understand these processes, transcranial magnetic stimulation has been used to probe corticospinal excitability at various time points during response preparation and initiation. Previous research has shown that excitability decreases prior to the “go” stimulus and increases following the “go”; however these two time frames have been examined independently. The purpose of this study was to measure changes in CE during both the foreperiod and reaction time interval in a single experiment, relative to a resting baseline level. Participants performed a button press movement in a simple reaction time task and excitability was measured during rest, the foreperiod, and the reaction time interval. Results indicated that during the foreperiod, excitability levels quickly increased from baseline with the presentation of the warning signal, followed by a period of stable excitability leading up to the “go” signal, and finally a rapid increase in excitability during the reaction time interval. This excitability time course is consistent with neural activation models that describe movement preparation and response initiation.     

Effect of Microiontophoretic Application of Modulators of Noradrenergic Transmission on Impulse Activity of Neurons of the Cat Motor Cortex during Performance of the Reflex to a Complex of Stimuli

On unanesthetized cats, we studied the effects of selective modulators of noradrenergic transmission on the activity of neurons of the cerebral motor cortex in the course of realization of an operant motor reflex to presentation of a complex of stimuli. These modulators were applied using microiontophoretic injections into sites of recording of impulse activity of cortical neurons within the zone of projection of the “working” forelimb. Applications of the α1 receptor agonist Mesaton resulted in significant suppression of background impulsation of the neurons and spiking within the interstimulus interval immediately during realization of the movement. Under the action of the α2 blocker yohimbine, opposite effects were observed. The activity of neurons increased within both background period and other examined time intervals. Mechanisms of the effects of modulation of noradrenergic transmission in the sensorimotor cortex are discussed.     

Comparison of neural activity in the supplementary motor area and in the primary motor cortex in monkeys.

Neuronal activity recorded from the primary motor cortex (MI) and from the supplementary motor area (SMA) was compared in two monkeys trained to perform conditioned arm movements. A handle had to be held in a central waiting position until a visual go and cueing signal indicated to the monkey to move the handle either to a medial or to a lateral target zone (choice reaction time paradigm). Unit and representative electromyographic data were analyzed in relation either to the go signal or to movement onset. In 240 penetrations, 431 SMA neurons and 353 MI neurons were found with activity related to the task. The majority of neurons (303 in MI, 290 in SMA) displayed activity changes after the go signal and before movement onset. Of these "short-lead neurons", 71% in MI and 41% in SMA were clearly related to movement execution. The distribution of lead times in MI and SMA neurons was completely overlapping without any statistical difference among subgroups. The remaining neurons were as well related to the go signal as to movement onset, or were better related to the visual go signal. The response latencies to this signal were not statistically different in SMA and MI neurons. Activity changes during the waiting period was observed more frequently in SMA (47%) than in MI (32%); modulations restricted to the waiting period occurred in 14% of SMA neurons, but were exceptional in MI neurons (3%). It is concluded from these experiments that a surprisingly large proportion of SMA neurons have "MI-like" properties, in that they are temporally recruited together with MI neurons, with similar patterns of discharges during the task. This then suggests that the two interconnected areas operate in parallel. A population of SMA neurons is involved in some processing that is not as predominantly expressed in MI. This activity could relate to sensory, timing, or other higher-order aspects of response preparation, and/or motor functions such as postural stabilization.     

Olfactory conditioning of proboscis activity in Drosophila melanogaster

Olfactory learning and memory processes in Drosophila have been well investigated with aversive conditioning, but appetitive conditioning has rarely been documented. Here, we report for the first time individual olfactory conditioning of proboscis activity in restrained Drosophila melanogaster. The protocol was adapted from those developed for proboscis extension conditioning in the honeybee Apis mellifera. After establishing a scale of small proboscis movements necessary to characterize responses to olfactory stimulation, we applied Pavlovian conditioning, with five trials consisting of paired presentation of a banana odour and a sucrose reward. Drosophila showed conditioned proboscis activity to the odour, with a twofold increase of percentage of responses after the first trial. No change occurred in flies experiencing unpaired presentations of the stimuli, confirming an associative basis for this form of olfactory learning. The adenylyl cyclase mutant rutabaga did not exhibit learning in this paradigm. This protocol generated at least a short-term memory of 15 min, but no significant associative memory was detected at 1 h. We also showed that learning performance was dependent on food motivation, by comparing flies subjected to different starvation regimes.     

Activation of VTA GABA neurons disrupts reward consumption

The activity of ventral tegmental area (VTA) dopamine (DA) neurons promotes behavioral responses to rewards and environmental stimuli that predict them. VTA GABA inputs synapse directly onto DA neurons and may regulate DA neuronal activity to alter reward-related behaviors; however, the functional consequences of selective activation of VTA GABA neurons remains unknown. Here, we show that in?vivo optogenetic activation of VTA GABA neurons disrupts reward consummatory behavior but not conditioned anticipatory behavior in response to reward-predictive cues. In addition, direct activation of VTA GABA projections to the nucleus accumbens (NAc) resulted in detectable GABA release but did not alter reward consumption. Furthermore, optogenetic stimulation of VTA GABA neurons directly suppressed the activity and excitability of neighboring DA neurons as well as the release of DA in the NAc, suggesting that the dynamic interplay between VTA DA and GABA neurons can control the initiation and termination of reward-related behaviors.     

Ingestion motor programs of Aplysia are modulated by short-term synaptic enhancement in cerebral-buccal interneuron pathways

In the sea slug Aplysia, buccal synapses of cerebral-buccal interneurons (CBIs) CBI-2 and CBI-12 exhibit short-term synaptic enhancement (STE), including frequency-dependant facilitation and augmentation/post-tetanic potentiation (AUG/PTP). The STE that results from driving CBI-2 or CBI-12 is associated with significantly decreased latency to burst onset in buccal premotor neurons and motor neurons, increased cycle frequency of ingestion buccal motor programs (iBMPs) and increased intraburst firing frequency of buccal neurons during iBMPs. Tests of paired-pulse facilitation during AUG/PTP suggest that the locus for this plasticity is presynaptic. The AUG/PTP is not elicited by heterosynaptic pathways, indicating that its origin is homosynaptic. At low CBI-2 and CBI-12 firing frequencies, STE is likely to contribute to iBMP initiation, while at higher firing frequencies, STE is correlated with increased cycle frequency of iBMPs. Thus, STE is an important component of the mechanisms whereby cerebral neurons regulate cyclic feeding programs and likely contributes to observed variations in behavioral responses, including feeding arousal. Electronic Publication     

Temporal Production Signals in Parietal Cortex

We often perform movements and actions on the basis of internal motivations and without any explicit instructions or cues. One common example of such behaviors is our ability to initiate movements solely on the basis of an internally generated sense of the passage of time. In order to isolate the neuronal signals responsible for such timed behaviors, we devised a task that requires nonhuman primates to move their eyes consistently at regular time intervals in the absence of any external stimulus events and without an immediate expectation of reward. Despite the lack of sensory information, we found that animals were remarkably precise and consistent in timed behaviors, with standard deviations on the order of 100 ms. To examine the potential neural basis of this precision, we recorded from single neurons in the lateral intraparietal area (LIP), which has been implicated in the planning and execution of eye movements. In contrast to previous studies that observed a build-up of activity associated with the passage of time, we found that LIP activity decreased at a constant rate between timed movements. Moreover, the magnitude of activity was predictive of the timing of the impending movement. Interestingly, this relationship depended on eye movement direction: activity was negatively correlated with timing when the upcoming saccade was toward the neuron''s response field and positively correlated when the upcoming saccade was directed away from the response field. This suggests that LIP activity encodes timed movements in a push-pull manner by signaling for both saccade initiation towards one target and prolonged fixation for the other target. Thus timed movements in this task appear to reflect the competition between local populations of task relevant neurons rather than a global timing signal.