Positive Reinforcement Training in Squirrel Monkeys Using Clicker Training

Nonhuman primates in research environments experience regular stressors that have the potential to alter physiology and brain function, which in turn can confound some types of research studies. Operant conditioning techniques such as positive reinforcement training (PRT), which teaches animals to voluntarily perform desired behaviors, can be applied to improve behavior and reactivity. PRT has been used to train rhesus macaques, marmosets, and several other nonhuman primate species. To our knowledge, the method has yet to be used to train squirrel monkeys to perform complex tasks. Accordingly, we sought to establish whether PRT, utilizing a hand‐box clicker (which emits a click sound that acts as the conditioned reinforcer), could be used to train adult male squirrel monkeys (Saimiri boliviensis, N = 14). We developed and implemented a training regimen to elicit voluntary participation in routine husbandry, animal transport, and injection procedures. Our secondary goal was to quantify the training time needed to achieve positive results. Squirrel monkeys readily learned the connection between the conditioned reinforcer (the clicker) and the positive reinforcer (food). They rapidly developed proficiency on four tasks of increasing difficulty: target touching, hand sitting, restraint training, and injection training. All subjects mastered target touching behavior within 2 weeks. Ten of 14 subjects (71%) mastered all tasks in 59.2 ± 2.6 days (range: 50–70 days). In trained subjects, it now takes about 1.25 min per monkey to weigh and administer an intramuscular injection, one‐third of the time it took before training. From these data, we conclude that clicker box PRT can be successfully learned by a majority of squirrel monkeys within 2 months and that trained subjects can be managed more efficiently. These findings warrant future studies to determine whether PRT may be useful in reducing stress‐induced experimental confounds in studies involving squirrel monkeys. Am. J. Primatol. 74:712–720, 2012. © 2012 Wiley Periodicals, Inc.     

Somatosensory-motor neuronal activity in the superior colliculus of the primate

The superior colliculus (SC) in primates plays an important role in orienting gaze and arms toward novel stimuli. Here we ask whether neurons in the intermediate and deep layers of the SC are also involved in the interaction with objects. In two trained monkeys we found a large number of SC units that were specifically activated when the monkeys contacted and pushed a target that had been reached with either hand. These neurons, however, were silent when the monkeys simply looked at or reached for the target but did not touch it. The activity related to interacting with objects was spatially tuned and increased with push strength. Neurons in the SC with this type of activity may be involved in a somatosensory-motor feedback loop that monitors the force of the active muscles together with the spatial position of the limb required for proper interaction with an object.     

Interspecific contrasts in responses of macaques to transport cage training

Corticosteroid values in response to brief confinement in a transport cage were compared between rhesus, bonnet, and crabeating macaques before and after they were trained to enter the cage. Behavioral data were collected to assess performance during training. Species differences were found both in training measures and in corticosteroid response to confinement in the transport cage after training. Bonnets took longer to train than rhesus or crabeaters. Rhesus showed the smallest adrenocortical response to cage confinement after training and crabeaters the greatest, suggesting that this group habituated more slowly to confinement than the other two groups. The results have implications for choice of experimental subject species and for management and husbandry of laboratory primates.     

Species of the genus Macaca (Cercopithecidea, primates) as research subjects in modern biology and medicine

Members of the genus Macaca are the most commonly used animals in biomedical research on primates. Macaca monkeys are used most extensively (from 50% to 73% of the general file) in rapidly developing branches of medical primatology (pharmacology, endocrinology, ophthalmology, stomatology, and central nervous system pathology and physiology), i.e., in those sciences where monkeys are absolutely necessary and where they are used with great efficacy.     

Quantitative data on training new world primates to urinate

This study assessed the effectiveness of operant conditioning in training three species of captive callitrichid primates (Leontopithecus rosalia, Callithrix geoffroyi, and Saguinus imperator) to urinate on demand. There were three goals to the study: 1) to develop a system for quantitatively assessing positive reinforcement training; 2) to ascertain whether or not positive reinforcement techniques can be used to train callitrichid monkeys to urinate on demand, and if so, how many training sessions are required; and 3) to determine the effect on urination behavior of the trainer entering the cage to collect a urine sample. Positive reinforcement with a continuous reinforcement schedule was used to capture a natural behavior: urination. Training sessions (30 min each) were conducted at dawn thrice weekly during five consecutive phases: habituation, control, training (animals were rewarded for urinating), maintenance (animals had reached a defined training criteria and continued to be rewarded for urinating), and collection (animals were rewarded for urinating, and the trainer entered the cage to collect the sample). The numbers of 30-min training sessions required to train the three monkey species (L. rosalia, C. geoffroyi, and S. imperator) were five, six, and eight, respectively. For the three species, the mean number of urinations per animal was significantly greater during the training, maintenance, and collection phases compared to the control phase. However, the three species differed significantly in the manner in which the rates of urination changed across the five phases. A higher proportion of subjects urinated during the training, maintenance, and collection phases compared to the control phase. Latency to first urination varied significantly across the five phases, with significantly reduced latencies to urinate during the training, maintenance, and collection phases compared to the control phase. The entry of the trainer into the cage to collect the urine sample did not appear to alter urination behavior. We demonstrate that operant conditioning techniques, which typically incur minimal cost, time investment, and disturbance, can be used to increase the quantity of urine samples collected for physiological analysis, the proportion of animals that urinate, and the speed of sample collection.     

Positive reinforcement training as a technique to alter nonhuman primate behavior: quantitative assessments of effectiveness

Many suggest that operant conditioning techniques can be applied successfully to improve the behavioral management of nonhuman primates in research settings. However, relatively little empirical data exist to support this claim. This article is a review of several studies that discussed applied positive reinforcement training techniques (PRT) on breeding/research colonies of rhesus macaques (Macaca mulatta) and chimpanzees (Pan troglodytes) at The University of Texas M. D. Anderson Cancer Center and measured their effectiveness. Empirical analyses quantified the amount of time required to train rhesus monkeys to come up, station, target, and stay. Additionally, a study found that time spent affiliating by female rhesus was changed as a function of training low affiliators to affiliate more and high affiliators to affiliate less. Another study successfully trained chimpanzees to feed without fighting and to come inside on command. PRT is an important behavioral management tool that can improve the care and welfare of primates in captivity. Published empirical findings are essential for managers to assess objectively the utility of positive reinforcement training techniques in enhancing captive management and research procedures.     

Social context affects how rhesus monkeys explore their environment

This study reports on social modulation of exploratory behavior and response to novelty by members of a captive rhesus monkey colony. The group was trained to split in half, with one subgroup composed of dominant members only, the other of subordinates. The animals were then presented the same initially novel stimuli (i.e., sand-filled metal boxes containing hidden food items) in two social contexts differing in hierarchical composition. In a combined context, all group members (i.e., both subgroups together) were simultaneously presented the stimuli. In a split context, only members of the top or bottom half of the group (i.e., each subgroup in turn) was independently presented the stimuli. Subordinates responded similarly to dominant animals in the combined context but differently in the split context, where they were far more hesitant. Rank-related differences were evident in the way animals used their home compound and in their approach and responsiveness toward the stimuli. These findings show that social context influences how animals explore novel situations, possibly reflecting different social roles or status effects on the perception of social structure. Also, despite the complexity of primate social relationships, the separation technique produced no permanent or adverse effects on the social integrity of the group. This study shows that manipulating the social environment through separation training can be a powerful tool for assessing contextual influences on behavior. Am. J. Primatol. 44:205–214, 1998. © 1998 Wiley-Liss, Inc.     

Social behavior and gender in biomedical investigations using monkeys: studies in atherogenesis.

We review the use of socially housed cynomolgus monkeys (Macaca fascicularis) in biomedical research with emphasis on studies of atherosclerosis, particularly in the two specific domains of atherosclerosis investigation for which nonhuman primates are especially well-suited as animal models: gender differences and psychosocial influences. We found that the presence of normal ovarian function prevented exacerbation of diet-induced coronary artery atherosclerosis in female monkeys. However, any manipulation or condition which impaired ovarian function tended to diminish or abolish this "female" protection. Among group-housed female monkeys, low social status was accompanied by ovarian dysfunction and, not surprisingly, by exacerbated coronary artery atherosclerosis as well. Surgical menopause (ovariectomy) also induced exacerbation of coronary atherosclerosis in monkeys, a situation which was prevented by estrogen replacement therapy. Conversely, pregnancy (a hyperestrogenic state) resulted in markedly diminished atherosclerosis. A somewhat different pattern of atherogenesis emerged among socially-housed males. Here, socially dominant animals developed exacerbated coronary artery atherosclerosis, but only under conditions of social stress (viz., disruption caused by periodic reorganization of social group membership). We hypothesized that exposure to repeated group reorganizations provoked activation of the sympathetic nervous system among dominant animals; in turn, the hemodynamic and metabolic concomitants of sympathetic activation may have damaged the coronary arteries of these monkeys, potentiating atherogenesis. To test this hypothesis, males were housed in unstable social groupings, with half of the monkeys administered a beta-adrenergic blocking agent (to attenuate heart rate and blood pressure responses to stress). The beta-blocker inhibited atherosclerosis, but only among those animals behaviorally predisposed to develop exacerbated lesions (i.e. dominant monkeys). These results support the view that monkeys are suitable research models of atherosclerosis, a disease that affects millions of humans.     

Spatial and Working Memory Is Linked to Spine Density and Mushroom Spines

Background

Changes in synaptic structure and efficacy including dendritic spine number and morphology have been shown to underlie neuronal activity and size. Moreover, the shapes of individual dendritic spines were proposed to correlate with their capacity for structural change. Spine numbers and morphology were reported to parallel memory formation in the rat using a water maze but, so far, there is no information on spine counts or shape in the radial arm maze (RAM), a frequently used paradigm for the evaluation of complex memory formation in the rodent.

Methods

24 male Sprague-Dawley rats were divided into three groups, 8 were trained, 8 remained untrained in the RAM and 8 rats served as cage controls. Dendritic spine numbers and individual spine forms were counted in CA1, CA3 areas and dentate gyrus of hippocampus using a DIL dye method with subsequent quantification by the Neuronstudio software and the image J program.

Results

Working memory errors (WME) and latency in the RAM were decreased along the training period indicating that animals performed the task. Total spine density was significantly increased following training in the RAM as compared to untrained rats and cage controls. The number of mushroom spines was significantly increased in the trained as compared to untrained and cage controls. Negative significant correlations between spine density and WME were observed in CA1 basal dendrites and in CA3 apical and basal dendrites. In addition, there was a significant negative correlation between spine density and latency in CA3 basal dendrites.

Conclusion

The study shows that spine numbers are significantly increased in the trained group, an observation that may suggest the use of this method representing a morphological parameter for memory formation studies in the RAM. Herein, correlations between WME and latency in the RAM and spine density revealed a link between spine numbers and performance in the RAM.     

Use of a mirror to direct their responses in Japanese monkeys (Macaca fuscata fuscata)

Two male Japanese monkeys used a mirror to inspect an object attached to their bodies but not directly visible. These monkeys had been trained previously to use a mirror to guide their hand to a target. In Experiment 1 their behavior in the presence of a mirror was observed. In Experiment 2 the monkeys used the mirror to locate a picture projected on a screen to the left or right rear side of the cage. In Experiment 3 the monkeys used a mirror to observe and finally grasp an object attached behind their heads. Two monkeys who were not trained to use a mirror to obtain an otherwise hidden object did not show such behavior.     

Response to novel object in Wistar and wild-type (WWCPS) rats

Laboratory rats react to a novel object with a rapid redirection of exploratory behaviour towards the source of the novelty and a subsequent decline of this neotic preference with repeated object exposure. Studies with wild Rattus norvegicus have shown that a novel object in a familiar cage results in avoidance reactions (neophobia) in those animals, but it is also well established that the wild R. norvegicus show strong aversive reactivity to a variety of high intensity stimuli. In this study we aimed to create low-stress conditions enabling the comparison of spontaneous exploratory behaviour directed at a novel object in male (age = 80 days) “wild-type” WWCPS rats (n = 21; fourth generation bred in captivity) and Wistar (n = 24) rats. The study involved repeated placing of individual animals in the experimental chamber for 15 (6 min) trials on consecutive days. On the 11th day the novel object was introduced. Animals were tested in darkness and without human presence. Under these conditions neither WWCPS nor Wistar have shown behavioural signs of high emotional arousal, both lines have shown comparable general levels of experimental cage exploration and the positive new object exploratory reaction was observed only in Wistar rats.     

Temporal distribution of rapid eye movements and related monophasic potentials in the brain stem following injection of an anticholinesterase.

The temporal distribution of the horizontal rapid eye movements and the related monophasic potentials recorded from the ascending MLF following intravenous injection of o.i mg/kg of anticholinesterase has been investigated in precollicular decerebrate animals. In particular the intervals between individual MLF potentials occurring during successive REM episodes have been evaluated over a total period of 2000 sec on each experiment. 2. There was a bimodal distribution of intervals due to the fact that all the rapid eye movements and the related MLF potentials were grouped in bursts which occurred at quite regular intervals. 3. During the cholinergically induced episodes of REM, there were usually bursts of REM in one direction followed by bursts of REM in the opposite direction. The mean number of individual eye movements within each burst was 4.67 +/- 0.84, S.D., while the average interval between the individual eye movements corresponded to 167 +/- 36 msec, S.D. 4. There was a great regularity in the periodic occurrence of the bursts of REM. In particular the mean interval between the beginning of a burst of REM in one direction (i.e., towards the left side) and that of the next train oriented in the opposite direction (i.e., towards the right side) was 1.97 +/- 0.47 sec, S.D., while the mean interval between the beginning of this last train and that of the successive train oriented in the former direction corresponded to 2.97 +/- 0.48 sec, S.D. Moreover, the duration of the whole period corresponding to the interval between two successive bursts of REM oriented in the same direction (i.e., towards left or towards right) corresponded on average to 4.94 +/- 0.55 sec S.D. and 4.99 +/- 0.52 sec, S.D. respectively. 5. In addition to these "simple bursts" of rapid eye movements oriented in one direction, there were "complex bursts" in which an alternation of the individual eye movements within each burst was observed. In these instances the mean number of spikes was greater (5.35 +/- 1.20, S.D.) and the mean interval shorter 119 +/- 44 msec, S.D.) than those observed in the "simple bursts", About 10-15% of the bursts occurring during the cholinergically induced REM episodes were of the complex type. 6. These findings obtained from an individual experiment were confirmed in all the decerebrate animals treated with the same dose of anticholinesterase; only slight quantitative differences were detected from case to case. 7. Since the bursts of REM induced by the anticholinesterase depend upon the activity of the vestibular nuclei, it is postulated that cholinergic reticular neurons activate structures which show waxing and waning in their activity before acting on the vestibulo-oculomotor system. This system probably contains the inhibitory interneurons which transform the regularly modulated input into a rhythmic vestibular output...     

Categorical perception of orientation in monkeys

Structural and functional substrates of orientation processing in monkeys have been clarified. However, orientation perception in monkeys has not been fully studied. In this study, the cognitive mechanism that controls monkeys' perception of orientation was evaluated. After the monkeys were trained to discriminate between a cardinal and an oblique orientation (e.g., 0 degrees and 30 degrees), their perceptual mechanisms underlying orientation discrimination were tested by using six orientations, ranging from 0 degrees to 150 degrees, including ones used in the discrimination training. Generalization tests showed that the monkeys who were trained with cardinal orientations (e.g., 0 degrees) as positive stimuli generalized their responses to the other cardinal orientation (e.g., 90 degrees). Similarly, the monkeys who were trained with oblique orientations (e.g., 30 degrees) as positive stimuli generalized their responses to all other oblique orientations (e.g., 60 degrees, 120 degrees, and 150 degrees). These findings indicated that the monkeys abstracted the quality of the cardinal/oblique category from the physical features of orientation stimuli although they were not trained to do so. Such an abstraction also suggested a discrepancy between a continuously and orderly arranged cortical map and a discontinuously categorized perception of orientation. The present findings provide insight into the learning-correlated plasticity of cortical orientation preference.     

Serum leptin in nonpregnant and pregnant women and in old and new world nonhuman primates

Leptin is a hormone that is produced during mammalian pregnancy in the placental trophoblast and other tissues, including! fetal and maternal adipocytes. Synthesis of the polypeptide and the presence of its specific receptors throughout the human maternal fetoplacental unit suggest direct effects on conceptus growth and development. However, both the physiologic roles of leptin and the mechanisms regulating leptin synthesis in human pregnancy differ from those in laboratory and domestic species, necessitating the development of non-human primate research models. Therefore, we compared serum leptin concentrations in nonpregnant and pregnant women with those in both old world nonhuman primates (i.e., baboon, rhesus monkey, cynomolgus monkey) and new world nonhuman primates (i.e., squirrel monkey, titi monkey). As expected, maternal leptin levels were elevated in human and baboon pregnancies (P < 0.05 and P < 0.001, respectively). Levels in both species of old world monkeys were also greatly enhanced (P < 0.001). Although maternal serum concentrations were slightly elevated compared to nonpregnant levels in both species of new world monkeys, overall concentrations were dramatically lower than for either old world primates or humans. Results provide comparisons of serum leptin concentrations in pregnant and nonpregnant humans and baboons with those in both old and new world monkeys and further characterize these nonhuman primates as models for the investigation of leptin dynamics in pregnancy.     

Functional relationships for determining similarities and differences in comparative cognition

Pigeons, capuchin monkeys and rhesus monkeys were trained in nearly identical same/different tasks with an expanding 8-item training set and showed qualitatively similar functional relationships: increasing novel-stimulus transfer (i.e., concept learning) as a function of the training-set size and the level of transfer eventually becoming equivalent to baseline training performance. There were also some quantitative functional differences: pigeon transfer increases were more gradual and baseline-equivalent transfer occurred at a larger set size (256 items) than for monkeys (128 items). Other pigeon groups trained at 32 and 64-item initial set sizes showed improved transfer (relative to expanding the 8-item training set), equivalent to the monkey species’ transfer at these same training set sizes. This finding of equivalent concept learning over a portion of the functional range (8, 32, and 64 items or 64-4096 training pairs) is discussed in terms of species differences: carryover effects from smaller-set training, evolved neural systems, cognitive and cortical modules, and general distributed learning systems for “higher-order” cognitive abilities.     

Oculomotor Examination of the Weapon Focus Effect: Does a Gun Automatically Engage Visual Attention?

Background

A person is less likely to be accurately remembered if they appear in a visual scene with a gun, a result that has been termed the weapon focus effect (WFE). Explanations of the WFE argue that weapons engage attention because they are unusual and/or threatening, which causes encoding deficits for the other items in the visual scene. Previous WFE research has always embedded the weapon and nonweapon objects within a larger context that provides information about an actor''s intention to use the object. As such, it is currently unknown whether a gun automatically engages attention to a greater extent than other objects independent of the context in which it is presented.

Method

Reflexive responding to a gun compared to other objects was examined in two experiments. Experiment 1 employed a prosaccade gap-overlap paradigm, whereby participants looked toward a peripheral target, and Experiment 2 employed an antisaccade gap-overlap paradigm, whereby participants looked away from a peripheral target. In both experiments, the peripheral target was a gun or a nonthreatening object (i.e., a tomato or pocket watch). We also controlled how unexpected the targets were and compared saccadic reaction times across types of objects.

Results

A gun was not found to differentially engage attention compared to the unexpected object (i.e., a pocket watch). Some evidence was found (Experiment 2) that both the gun and the unexpected object engaged attention to a greater extent compared the expected object (i.e., a tomato).

Conclusion

An image of a gun did not engage attention to a larger extent than images of other types of objects (i.e., a pocket watch or tomato). The results suggest that context may be an important determinant of WFE. The extent to which an object is threatening may depend on the larger context in which it is presented.     

A case study employing operant conditioning to reduce stress of capture for red-bellied tamarins (Saguinus labiatus)

Traditional techniques used to capture New World monkeys, such as net capture, can induce high levels of acute stress detrimental to welfare. Alternatively, training nonhuman animals via operant conditioning to voluntarily participate in husbandry and/or veterinary practices is accepted as a humane process that can reduce stress and improve welfare. This study details the use of operant conditioning using positive reinforcement training (PRT) and target training to train a family of 5 captive red-bellied tamarins (Saguinus labiatus) in a wildlife park to voluntarily enter a transportation box and remain calm for 1 min after 54 training sessions. Observations of 2 unrelated net-capture processes provided measures of locomotion and vocalizations as indicators of stress behavior that were compared with those of the trained tamarins. Net-captured monkeys exhibited rapid erratic locomotion and emitted long, high-frequency vocalizations during capture whereas the trained tamarins exhibited minimal locomotion and emitted only 4 brief vocalizations (root mean square 35 dB) during capture. This indicates that the use of PRT considerably reduced potential for stress and improved welfare during the capture and containment of the tamarins.     

Is the Clavicle of Apes Long? An Investigation of Clavicular Length in Relation to Body Mass and Upper Thoracic Width

An elongated clavicle is one of the distinct features of apes and humans. It plays an important role in providing mobility as well as stability for the shoulder joints. The relative length of the clavicle is an especially important factor in limiting the range of shoulder joint excursion. It is said that among primates, Asian apes, i.e., gibbons and orang-utans, have very long clavicles. At the same time, they also have a wide upper thoracic cage, which may diminish the effective length of the clavicle. To clarify the length of the clavicle in apes, from the standpoint of the functional anatomy of the shoulder girdle, we examined clavicular length in 15 anthropoid species exhibiting various positional behaviors. The results confirm that clavicle length in Asian apes is long, and chimpanzees have a short clavicle like that of Old and New World monkeys, when scaled to body mass. The clavicular length of chimpanzees, however, is intermediate between Old World monkeys and Asian apes when scaled against thoracic width. Therefore, living apes can be grouped together, albeit just barely, by possession of a relatively long clavicle for their thoracic cage size. Interestingly, New World monkeys tend to exhibit a longer clavicle than Old World monkeys of equivalent body mass or thoracic cage width. Although it is unclear whether the ancestral condition of clavicular length in anthropoids was similar to that of living Old or New World monkeys, an elongation of clavicle was an important step toward evolution of the modern body plan of hominoids.     

Self-aggression in macaques: Five case studies

Spontaneous self-aggressive behaviors were observed in five adult male rhesus monkeys (Macaca mulatta) housed at a university facility. All were individually caged, were free of intercurrent disease, and were being utilized in ongoing research studies. The self-aggressive behaviors observed included self-biting, self-clasping, self-slapping, self-rubbing and threatening of body parts. In several cases, wounds were inflicted and medical treatment was required due to the severity of the lesions. A review of the animals' clinical histories revealed an increased level of self-aggressive behavior in four of five monkeys during such stressful or stimulating conditions as movement of the animal to a new cage, movement of animals out of the room or escape of other monkeys from their cages. The frequency with which these behaviors occurred was quantitated experimentally. The results revealed an increased level of self-aggressive behavior in two of these animals during the videotaped sessions in response to aggressive contacts with the investigator. In contrast, one monkey exhibited self-aggressive behavior both clinically and experimentally in the absence of environmental stimuli or human contact. Clinical management of self-aggressive monkeys included housing monkeys only with physically smaller primates, decreasing the level of environmental stimuli, and drug therapy. Haloperidol was used with success in one animal that exhibited severe self-aggressive behavior.     

A Case Study Employing Operant Conditioning to Reduce Stress of Capture for Red-Bellied Tamarins (Saguinus labiatus)

Traditional techniques used to capture New World monkeys, such as net capture, can induce high levels of acute stress detrimental to welfare. Alternatively, training nonhuman animals via operant conditioning to voluntarily participate in husbandry and/or veterinary practices is accepted as a humane process that can reduce stress and improve welfare. This study details the use of operant conditioning using positive reinforcement training (PRT) and target training to train a family of 5 captive red-bellied tamarins (Saguinus labiatus) in a wildlife park to voluntarily enter a transportation box and remain calm for 1 min after 54 training sessions. Observations of 2 unrelated net-capture processes provided measures of locomotion and vocalizations as indicators of stress behavior that were compared with those of the trained tamarins. Net-captured monkeys exhibited rapid erratic locomotion and emitted long, high-frequency vocalizations during capture whereas the trained tamarins exhibited minimal locomotion and emitted only 4 brief vocalizations (root mean square 35 dB) during capture. This indicates that the use of PRT considerably reduced potential for stress and improved welfare during the capture and containment of the tamarins.