Reorganization of Composition of Striatal Neurons Correlating with Behavior in the Monkey Macaca nemestrina

The available experimental data do not provide a sufficiently complete picture of the neuronal activity connected with some action of the animal, as they have been obtained under different experimental protocols and as a result of study of different cells. The present work was aimed at studying activity of the same neuron group at different moments of animal's behavior. A monkey (Macaca nemestrina) was taught to perform a behavioral program consisting of several functional heterogeneous actions. The impulsive activity of striatal neurons was recorded in the central region of putamen with coordinates A 16.5, L7, and H 8–10 [18]. The activity of each neuron was recorded during 13 consecutive stages of the same behavioral task. As a whole, in 59 putamen neurons, 767 fragments of neuronal activity were studied. It was shown that the same neurons could be involved at different behavioral stages when the animal performed different actions. At individual stages, the number of neurons common with other behavioral stages reached 70–80% of all reactive cells at the stage. The number of the neurons common within the rest of 12 stages was determined for every program stage. The number of such common neurons established in the experiment was in 142 out of 156 cases higher than their number that could be expected on the basis of statistical relations. The data obtained indicate that the reorganization in composition of behavior-reactive cells at every behavioral stage occurs mainly by using the same neurons but not only the neurons that are specialized for the given action. The polymodality of individual striatal neurons is unlikely to be connected with that they have several functions, but results from that the same neuron can be a constituent of neuronal mosaics of different configurations corresponding to different behavioral moments.     

Neuronal activity of the monkey striatum points at the integration of successive actions into functional blocks

In order to study the role of the striatum in generation of multistage behavior, the spike activity of 148 cells was recorded in the monkey brain putamen. Two kinds of neuron responses were observed. Phasic response involved activity during only one stage of the behavior program, and tonic response involved activity during more than one sequential stage. The tonic responses were recorded in 132 neurons out of 148, 11 neurons responding only as tonic. Other 121 cells show under different conditions both tonic and phasic responses. Beginnings and ends of "tonic" responses as a rule corresponded to the start and completion of the nearest behavioral aim. The obtained data suggest that the neuron activity of striatum is related not only to the control of individual movements but also to the whole structure of behavior.     

Neuronal correlates of the integrative activity in the monkey striatum

The unit activity was studied in monkeys during various behavioural activities. The striatum unit responses revealed no functional specifics. Separate units reflected the character of activity in their firing rate as well as in different interrelationships between excitatory and inhibitory responses. The putamen units were shown to discriminate experimental alternatives mainly when the money arrived at a decision, and successful solving of the problem was shown to depend on the level of the discrimination. Specific corticofugal signals from different and dispersed cortical areas seem to converge while interacting at the striatum.     

Dynamics of population code for working memory in the prefrontal cortex

Some neurons (delay cells) in the prefrontal cortex elevate their activities throughout the time period during which the animal is required to remember past events and prepare future behavior, suggesting that working memory is mediated by continuous neural activity. It is unknown, however, how working memory is represented within a population of prefrontal cortical neurons. We recorded from neuronal ensembles in the prefrontal cortex as rats learned a new delayed alternation task. Ensemble activities changed in parallel with behavioral learning so that they increasingly allowed correct decoding of previous and future goal choices. In well-trained rats, considerable decoding was possible based on only a few neurons and after removing continuously active delay cells. These results show that neural activity in the prefrontal cortex changes dynamically during new task learning so that working memory is robustly represented and that working memory can be mediated by sequential activation of different neural populations.     

Behavior-related neuronal reactions and dynamics of neuronal activity

Functionally, behavior-related discharges of associative neurons are an efferent flow of pulses continuously generated over the course of each behavioral act of an animal. However, predominant research approaches are based on the "stimulus - reaction" principle. Analysis of the dynamics of unit activity in monkeys during performance of a multi-step behavioral complex showed that differences related to different behavioral acts consist in composition changes in the active neurons (or their recombination) rather than in a number of responsive cells or involvement of action-specific neurons. Each combination of active neurons ensures the distribution of efferent signals characteristic of the given combination. These findings suggest the addressing coding of the efferent neuronal signals.     

Cholinergic interneuron characteristics and nicotinic properties in the striatum

The neostriatum (dorsal striatum) is composed of the caudate and putamen. The ventral striatum is the ventral conjunction of the caudate and putamen that merges into and includes the nucleus accumbens and striatal portions of the olfactory tubercle. About 2% of the striatal neurons are cholinergic. Most cholinergic neurons in the central nervous system make diffuse projections that sparsely innervate relatively broad areas. In the striatum, however, the cholinergic neurons are interneurons that provide very dense local innervation. The cholinergic interneurons provide an ongoing acetylcholine (ACh) signal by firing action potentials tonically at about 5 Hz. A high concentration of acetylcholinesterase in the striatum rapidly terminates the ACh signal, and thereby minimizes desensitization of nicotinic acetylcholine receptors. Among the many muscarinic and nicotinic striatal mechanisms, the ongoing nicotinic activity potently enhances dopamine release. This process is among those in the striatum that link the two extensive and dense local arbors of the cholinergic interneurons and dopaminergic afferent fibers. During a conditioned motor task, cholinergic interneurons respond with a pause in their tonic firing. It is reasonable to hypothesize that this pause in the cholinergic activity alters action potential dependent dopamine release. The correlated response of these two broad and dense neurotransmitter systems helps to coordinate the output of the striatum, and is likely to be an important process in sensorimotor planning and learning.     

Convergence of Signals and Reorganization of Neuronal Activity in a Model of Neuronal Network and in Striatum of the Monkey Brain

To elucidate principles of neuronal organization providing preservation of informational content of converging impulse flows in afferent impulsation of neurons, a comparison is performed of results obtained in the previously carried out experiments on a model of neuronal network and in a study of correlates of behavior in the neuronal network of the monkey brain neostriatum (putamen). This comparison has shown that responses of the neuronal network model to different ratio of input impulse flows and changes of the neostriatal neuronal activity, which accompany different behavioral actions, are seen the most clearly in reorganization of composition of the most active neurons. Each combination of input signals and each behavioral action of the animal correspond to a non-repeated mosaic of neuronal activity. The data obtained indicate that the neuronal network, both real and in the simplest model variant, is able to transform the converging input signals into the mosaic equivalent to their entire combination and thereby to transmit the result of generalization of the input signals of the network to the innervated brain structures.     

Decision-making in the leech nervous system

Previous models of behavioral choice have described two types of hierarchy, a decision hierarchy, in which different classes of decisions are made at each level (Tinbergen, 1951), and a behavioral hierarchy, in which one behavior will take precedence over others (Davis, 1985). Most experimental work on the neuronal basis of decision-making has focussed on the latter of these: a behavioral hierarchy is described for an animal, and the neuronal basis for this hierarchy, hypothesized to depend on inhibitory interactions, is investigated. Although the concept of "dedicated command neurons" has been useful for guiding these studies, it appears that such neurons are rare. We present evidence that in the leech, most neurons, including high-level decision neurons, are active in more than one behavior. We include data from one newly-identified neuron that elicits both swimming and crawling motor patterns. We suggest that decisions are made by a "combinatorial code": what behavior is produced depends on the specific combination of decision neurons that are active at a particular time. Finally, we discuss how decision neurons may be arranged into a decision hierarchy, with neurons at each sequential level responsible for choosing between a narrower range of behaviors. We suggest additional sensory information is incorporated at each level to inform the decision.     

Striatal GABAergic Neuronal Activity Is Not Reduced in Parkinson''s Disease

The content of gamma-aminobutyric acid (GABA) and the activities of glutamic acid decarboxylase (GAD) and tyrosine hydroxylase (TH) were measured in whole putamen obtained at autopsy from 13 patients dying with idiopathic Parkinson's disease and 13 appropriate control subjects. Mean GABA content was significantly elevated (by 28%) in the putamen of the Parkinson's disease patients. TH activity was markedly reduced, while there was no significant reduction of GAD activity in the putamen of these patients. GABA content was also measured in both sides of the striatum in rats which had received unilateral injections of 6-hydroxydopamine (6-OHDA) in the vicinity of the axons of the nigrostriatal projection. Mean GABA content was found significantly elevated (by 33%) in the ipsilateral striatum. Loss of dopaminergic nigrostriatal neurons, in both human Parkinson's disease and in the rat 6-OHDA model, is accompanied by increased striatal GABA content. The assumption that GABAergic neurotransmission is reduced in the striatum in Parkinson's disease may not be correct.     

The dynamics of neuron activity level in the striatum of the monkey brain in relation to the realization of multistage behavior

Level of the unit activity was studied in the monkey putamen during multistage behavior. Two groups of neuron activity patterns were distinguished. The first one involved patterns of low level neuron activity less exceeding the background level than the second one; the other group involved patterns of high level neuron activity exceeding the background level in the second time. These kinds of patterns were behavior-related. Patterns with low level neuron activity were recorded preferentially in relation to the trigger stimuli and reward. Patterns of high level neuron activity were recorded in relation to the decision-making, movements of arms in the left and right directions. Besides, their number rose in relation to the auditory cue reported to right realization of the task. It was established that the number of patterns of high level neuron activity rose in key moments of behavior, while the number of the patterns of low level neuron activity decreased.     

Sequential rearrangements of ensemble activity of the putamen neurons of monkeys as a correlate to continuous behavior

Simultaneous recording of unit activity of 6-8 putamen neurons in two monkeys (M. nemestrina and M. mulatta) during performance of the task of alternative spatial choice, was carried out. The extent of rearrangements of the activity in the groups of neurons with the transition from every step of the behavioral program to the next one and the degree of difference in mosaics of reactivity, forming at every step with a different variants of performance, were evaluated using discriminative analysis. The rearrangements of the impulse activity were recorded in all steps of the program. The dynamics of rearrangements with the choice of right or left feeder was different, which resulted in appearance of significant differences in mosaics of reactivity at the stage of decision making and receiving reward. The rearrangements preceding the task-oriented movement of one hand were more pronounced in the contralateral hemisphere. The volume of rearrangements may increase with the performance of movement but the differences of mosaics formed during the movement of right and left hand are decreasing. At the stage of reception of the reward, the rearrangements were greater in case the animal chose the certain (left) feeder irrespective of the side of recording the unit activity.     

Sexual Interactions Influence the Molecular Oscillations in DN1 Pacemaker Neurons in Drosophila melanogaster

Circadian rhythms can synchronize to environmental time cues, such as light, temperature, humidity, and food availability. Previous studies have suggested that these rhythms can also be entrained by social interactions. Here, we used Drosophila melanogaster as a model to study the influence of socio-sexual interactions on the circadian clock in behavior and pacemaker neurons. If two flies of opposite sex were paired and kept in a small space, the daily activity patterns of the two flies were clearly different from the sum of the activity of single male and female flies. Compared with single flies, paired flies were more active in the night and morning, were more active during females’ active phase, and were less active during males’ active phase. These behavioral phenotypes are related to courtship behavior, but not to the circadian clock. Nevertheless, in male-female pairs of flies with clocks at different speeds (wild-type and per ^S flies), clock protein cycling in the DN1 pacemaker neurons in the male brain were slightly influenced by their partners. These results suggest that sexual interactions between male-female couples can serve as a weak zeitgeber for the DN1 pacemaker neurons, but the effect is not sufficient to alter rhythms of behavioral activity.     

Interhemispheric relations of prefrontal cortical neurons in rats during emotional stimulation of increasing intensity

Unit activity of the prefrontal cortex of the right and left brain hemispheres of rats was recorded during intracranial stimulation of emotionally positive and negative brain structures. The neurons were divided according to their reaction to a change in food motivation: cells that decrease (M-neurons) and cells that increase their firing frequencies (R-neurons) after feeding. Three levels of stimulation current intensity were used. When stimuli of subthreshold intensity (evoking the behavioral reaction of smelling) were applied, the recorded neuronal activity was higher in the left hemisphere. During threshold emotionally positive or negative stimulation (producing approach behavior or freezing, respectively), activity of M-neurons was higher in the right hemisphere, whereas the left-side R-neurons were more active than the right-side ones. During strong emotionally positive stimulation producing self-stimulation, the firing frequency of both groups of neurons was higher in the left hemisphere. Strong emotionally negative stimulation that evoked behavioral avoidance to a greater extent activated the right hemisphere.     

Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology

Neurons in a small number of brain structures detect rewards and reward-predicting stimuli and are active during the expectation of predictable food and liquid rewards. These neurons code the reward information according to basic terms of various behavioural theories that seek to explain reward-directed learning, approach behaviour and decision-making. The involved brain structures include groups of dopamine neurons, the striatum including the nucleus accumbens, the orbitofrontal cortex and the amygdala. The reward information is fed to brain structures involved in decision-making and organisation of behaviour, such as the dorsolateral prefrontal cortex and possibly the parietal cortex. The neural coding of basic reward terms derived from formal theories puts the neurophysiological investigation of reward mechanisms on firm conceptual grounds and provides neural correlates for the function of rewards in learning, approach behaviour and decision-making.     

Getting formal with dopamine and reward

Recent neurophysiological studies reveal that neurons in certain brain structures carry specific signals about past and future rewards. Dopamine neurons display a short-latency, phasic reward signal indicating the difference between actual and predicted rewards. The signal is useful for enhancing neuronal processing and learning behavioral reactions. It is distinctly different from dopamine's tonic enabling of numerous behavioral processes. Neurons in the striatum, frontal cortex, and amygdala also process reward information but provide more differentiated information for identifying and anticipating rewards and organizing goal-directed behavior. The different reward signals have complementary functions, and the optimal use of rewards in voluntary behavior would benefit from interactions between the signals. Addictive psychostimulant drugs may exert their action by amplifying the dopamine reward signal.     

Differentiating activity of monkey putamen neurons during performance of the alternative spatial choice

Single unit activity was recorded in monkeys in three putamen zones learned a bimanual operant activity during performance of the task of alternative spatial choice. The neuronal reactions were specially analyzed by the criteria as follows: a) differentiation of the side of reward (differentiating--non-differentiating reactions); b) character of reaction by duration (tonic-phasic); c) laterality (contra- and ipsilateral reactions as related to hemisphere); d) frequency of background activity. It was shown that differentiating cell activity, especially their tonic part and in still greater degree contra-lateral tonic reactions most closely correlate with behavioral aspects of the program. The assumption that differentiating activity, unlike non-differentiating one, is the reflection of not only morphological and neurochemical characteristic features of nervous elements of putamen but of its functional uniformity in relation to external determinants of behavior, was put forward.     

Representing episodes in the mammalian brain

Memory lets the past inform the present so that we can attain future goals. In many species, these abilities require the hippocampus. Recent experiments, in which memory demand was varied while overt behavior and the environment were kept constant, have revealed firing patterns of hippocampal neurons that corresponded with memory demands and predicted performance. Although the active population appeared to be 'place cells' that signalled location, it actually included cells the activity patterns of which distinguished the recent or pending history of behavior during identical actions that occurred in the same place. Different populations of hippocampal cells fired as a rat walked along the same spatial path on the way to different goals, and coded past, present and pending events. Other experiments provide converging data that neuronal activity is modulated by goal-directed behavioral episodes. Together, these firing patterns suggest a testable mechanism of episodic memory coding: that hippocampal dynamics encode a temporally extended, hierarchically organized representation of goal-directed behavior.     

Ensemble activity of neurons in the visual, frontal, and sensorimotor cortices and dorsal striatum during actualization of behavioral program under conditions of strategy choice

Unit and network activity of neurons in the visual, sensorimotor, and frontal cortical areas and dorsal striatum was investigated in cats under conditions of choice of the reinforcement value depending on its delay. The animals did not differ from each other in behavior. After immediate or delayed responses cats got low- or highly-valuable reinforcement, respectively. Single-unit activity in the visual and sensorimotor cortical areas and dorsal striatum was similar during performance of immediate and delayed responses. However, significant inhibition was observed in the frontal neurons during the delay period. The network activity of visual and frontal cortex displayed smaller number of interneuronal interactions during delayed responses as compared to immediate reactions. The network activity of neurons in the brain structures under study pointed to the interstructural interaction, but only during delayed reactions, steady interneuronal communication was observed between the frontal cortex and dorsal striatum. Thus, both types of estimation of cellular activity revealed differences in the ensemble organization during different types of behavior and showed specific reactions of neuronal ensembles.     

Complex Population Response of Dorsal Putamen Neurons Predicts the Ability to Learn

Day-to-day variability in performance is a common experience. We investigated its neural correlate by studying learning behavior of monkeys in a two-alternative forced choice task, the two-armed bandit task. We found substantial session-to-session variability in the monkeys’ learning behavior. Recording the activity of single dorsal putamen neurons we uncovered a dual function of this structure. It has been previously shown that a population of neurons in the DLP exhibits firing activity sensitive to the reward value of chosen actions. Here, we identify putative medium spiny neurons in the dorsal putamen that are cue-selective and whose activity builds up with learning. Remarkably we show that session-to-session changes in the size of this population and in the intensity with which this population encodes cue-selectivity is correlated with session-to-session changes in the ability to learn the task. Moreover, at the population level, dorsal putamen activity in the very beginning of the session is correlated with the performance at the end of the session, thus predicting whether the monkey will have a "good" or "bad" learning day. These results provide important insights on the neural basis of inter-temporal performance variability.     

Rhythmic Firing of Pedunculopontine Tegmental Nucleus Neurons in Monkeys during Eye Movement Task

The pedunculopontine tegmental nucleus (PPTN) has been thought to be involved in the control of behavioral state. Projections to the entire thalamus and reciprocal connections with the basal ganglia nuclei suggest a potential role for the PPTN in the control of various rhythmic behaviors, including waking/sleeping and locomotion. Recently, rhythmic activity in the local field potentials was recorded from the PPTN of patients with Parkinson''s disease who were treated with levodopa, suggesting that rhythmic firing is a feature of the functioning PPTN and might change with the behaving conditions even within waking. However, it remains unclear whether and how single PPTN neurons exhibit rhythmic firing patterns during various behaving conditions, including executing conditioned eye movement behaviors, seeking reward, or during resting. We previously recorded from PPTN neurons in healthy monkeys during visually guided saccade tasks and reported task-related changes in firing rate, and in this paper, we reanalyzed these data and focused on their firing patterns. A population of PPTN neurons demonstrated a regular firing pattern in that the coefficient of variation of interspike intervals was lower than what would be expected of theoretical random and irregular spike trains. Furthermore, a group of PPTN neurons exhibited a clear periodic single spike firing that changed with the context of the behavioral task. Many of these neurons exhibited a periodic firing pattern during highly active conditions, either the fixation condition during the saccade task or the free-viewing condition during the intertrial interval. We speculate that these task context-related changes in rhythmic firing of PPTN neurons might regulate the monkey''s attentional and vigilance state to perform the task.