Easy Rider: Monkeys Learn to Drive a Wheelchair to Navigate through a Complex Maze

The neurological bases of spatial navigation are mainly investigated in rodents and seldom in primates. The few studies led on spatial navigation in both human and non-human primates are performed in virtual, not in real environments. This is mostly because of methodological difficulties inherent in conducting research on freely-moving monkeys in real world environments. There is some incertitude, however, regarding the extrapolation of rodent spatial navigation strategies to primates. Here we present an entirely new platform for investigating real spatial navigation in rhesus monkeys. We showed that monkeys can learn a pathway by using different strategies. In these experiments three monkeys learned to drive the wheelchair and to follow a specified route through a real maze. After learning the route, probe tests revealed that animals successively use three distinct navigation strategies based on i) the place of the reward, ii) the direction taken to obtain reward or iii) a cue indicating reward location. The strategy used depended of the options proposed and the duration of learning. This study reveals that monkeys, like rodents and humans, switch between different spatial navigation strategies with extended practice, implying well-conserved brain learning systems across different species. This new task with freely driving monkeys provides a good support for the electrophysiological and pharmacological investigation of spatial navigation in the real world by making possible electrophysiological and pharmacological investigations.     

An observational learning task using Barnes maze in rats

Observational learning, which modulates one’s own behavior by observing the adaptive behavior of others, is crucial for behaving efficiently in social communities. Although many behavioral experiments have reported observational learning in monkeys and humans, its neural mechanisms are still unknown. In order to conduct neuroscientific researches with recording neural activities, we developed an observational learning task for rats. We designed the task using Barnes circular maze and then tested whether rats (observers) could actually improve their learning by observing the behavior of other rats (models) that had already acquired the task. The result showed that the observer rats, which were located in a metal wire mesh cylinder at the center of the maze and allowed to observe model rats escaping to the goal in the maze, demonstrated significantly faster escape behavior than the model rats. Thus, the present study confirmed that rats can efficiently learn the behavioral task by observing the behavior of other rats; this shows that it is conceivable to elucidate the neural mechanisms of social interaction by analyzing neural activity in observer rats performing the observational learning task.     

The development and stability of estrogen-modulated spatial navigation strategies in female rats

Adult female rats with high levels of circulating estradiol are biased to use a place strategy to solve an ambiguous spatial navigation task and those with low levels are biased to use a response strategy. We examined the development of this hormonal modulation of strategy use by training juvenile female rats on an ambiguous navigation task and probing them for strategy use at postnatal day (PD) 16, 21, or 26, after administration of 17 β-estradiol or oil 48 and 24 h prior to testing. We found that rats could use either strategy successfully by PD21 but that estradiol did not bias rats to use a place strategy until PD26. In order to evaluate the stability of this effect over multiple navigation experiences, we retested oil-treated juveniles three times during adulthood. On the first adult navigation experience, rats were significantly more likely to use the same navigation strategy they used as juveniles, regardless of current estrous cycle phase. On the second and third adult tests, after rats had more experience with the task, previous navigation experience did not predict strategy use. Rats in proestrus were significantly more likely to use a place strategy while rats in estrus and diestrus did not appear to have a group bias to use either strategy. These results suggest that estradiol can modulate spatial navigation strategy use before puberty but that this effect interacts with previous navigation experience. This study sheds light on when and under what circumstances estradiol gains control over spatial navigation behavior in the female rat.     

Odor supported place cell model and goal navigation in rodents

Experiments with rodents demonstrate that visual cues play an important role in the control of hippocampal place cells and spatial navigation. Nevertheless, rats may also rely on auditory, olfactory and somatosensory stimuli for orientation. It is also known that rats can track odors or self-generated scent marks to find a food source. Here we model odor supported place cells by using a simple feed-forward network and analyze the impact of olfactory cues on place cell formation and spatial navigation. The obtained place cells are used to solve a goal navigation task by a novel mechanism based on self-marking by odor patches combined with a Q-learning algorithm. We also analyze the impact of place cell remapping on goal directed behavior when switching between two environments. We emphasize the importance of olfactory cues in place cell formation and show that the utility of environmental and self-generated olfactory cues, together with a mixed navigation strategy, improves goal directed navigation.     

Teaching the Blind to Find Their Way by Playing Video Games

Computer based video games are receiving great interest as a means to learn and acquire new skills. As a novel approach to teaching navigation skills in the blind, we have developed Audio-based Environment Simulator (AbES); a virtual reality environment set within the context of a video game metaphor. Despite the fact that participants were naïve to the overall purpose of the software, we found that early blind users were able to acquire relevant information regarding the spatial layout of a previously unfamiliar building using audio based cues alone. This was confirmed by a series of behavioral performance tests designed to assess the transfer of acquired spatial information to a large-scale, real-world indoor navigation task. Furthermore, learning the spatial layout through a goal directed gaming strategy allowed for the mental manipulation of spatial information as evidenced by enhanced navigation performance when compared to an explicit route learning strategy. We conclude that the immersive and highly interactive nature of the software greatly engages the blind user to actively explore the virtual environment. This in turn generates an accurate sense of a large-scale three-dimensional space and facilitates the learning and transfer of navigation skills to the physical world.     

Reversal Learning and Associative Memory Impairments in a BACHD Rat Model for Huntington Disease

Chorea and psychiatric symptoms are hallmarks of Huntington disease (HD), a neurodegenerative disorder, genetically characterized by the presence of expanded CAG repeats (>35) in the HUNTINGTIN (HTT) gene. HD patients present psychiatric symptoms prior to the onset of motor symptoms and we recently found a similar emergence of non motor and motor deficits in BACHD rats carrying the human full length mutated HTT (97 CAG-CAA repeats). We evaluated cognitive performance in reversal learning and associative memory tests in different age cohorts of BACHD rats. Male wild type (WT) and transgenic (TG) rats between 2 and 12 months of age were tested. Learning and strategy shifting were assessed in a cross-maze test. Associative memory was evaluated in different fear conditioning paradigms (context, delay and trace). The possible confound of a fear conditioning phenotype by altered sensitivity to a ‘painful’ stimulus was assessed in a flinch-jump test. In the cross maze, 6 months old TG rats showed a mild impairment in reversal learning. In the fear conditioning tasks, 4, 6 and 12 months old TG rats showed a marked reduction in contextual fear conditioning. In addition, TG rats showed impaired delay conditioning (9 months) and trace fear conditioning (3 months). This phenotype was unlikely to be affected by a change in ‘pain’ sensitivity as WT and TG rats showed no difference in their threshold response in the flinch-jump test. Our results suggest that BACHD rats have a profound associative memory deficit and, possibly, a deficit in reversal learning as assessed in a cross maze task. The time course for the emergence of these symptoms (i.e., before the occurrence of motor symptoms) in this rat model for HD appears similar to the time course in patients. These data suggest that BACHD rats may be a useful model for preclinical drug discovery.     

Locating and navigation mechanism based on place-cell and grid-cell models

Extensive experiments on rats have shown that environmental cues play an important role in goal locating and navigation. Major studies about locating and navigation are carried out based only on place cells. Nevertheless, it is known that navigation may also rely on grid cells. Therefore, we model locating and navigation based on both, thus developing a novel grid-cell model, from which firing fields of grid cells can be obtained. We found a continuous-time dynamic system to describe learning and direction selection. In our simulation experiment, according to the results from physiology experiments, we successfully rebuild place fields of place cells and firing fields of grid cells. We analyzed the factors affecting the locating accuracy. Results show that the learning rate, firing threshold and cell number can influence the outcomes from various tasks. We used our system model to perform a goal navigation task and showed that paths that are changed for every run in one experiment converged to a stable one after several runs.     

The hippocampus and flexible spatial knowledge in rats

Lesions to the hippocampal system in rats result in a profound impairment of place or locale spatial learning although other learning strategies remain unaltered. The main objective of the present study was to investigate whether the spatial knowledge preserved in the hippocampal animals can be expressed flexibly under conditions different from those of the acquisition period. Rats with neurotoxic lesions to the dorsal hippocampus and sham-operated subjects were trained to reach the goal arm in a four-arm plus-shaped maze using a constant starting arm. During the training a transparent plexiglas barrier divided the maze in two equal halves in such a way that the animals could only travel from the starting arm to the goal arm, not having access to the remaining 50% of the maze. After seven days of training, a transfer test was used in which the starting arms were the two arms from which the animals had not started during the training phase. Results indicated that the lesioned rats made significantly more errors than the control subjects. But the most interesting results revealed that the kind of error made by the lesioned animals was congruent with the turn that they had to make during the acquisition phase in order to access the goal arm (reinforced). These results suggest that when the hippocampus is damaged a preserved highly inflexible egocentric strategy is employed to solve the spatial problem.     

Evidence for hippocampal role in place avoidance other than merely memory storage

Spatial navigation is used as a popular animal model of higher cognitive functions in people. The data suggest that the hippocampus is important for both storing spatial memories and for performing spatial computations necessary for navigation. Animals use multiple behavioral strategies to solve spatial tasks often using multiple memory systems. We investigated how inactivation of the rat hippocampus affects performance in a place avoidance task to determine if the role of the hippocampus in this task could be attributed to memory storage/retrieval or to the computations needed for navigation. Injecting tetrodotoxin (TTX) into both hippocampi impaired conditioned place avoidance, but after injecting only one hippocampus, the rats learned the place avoidance as well as without any injections. Retention of the place avoidance learned with one hippocampus was not impaired when the injection was switched to the hippocampus that had not been injected during learning. The result suggests that during learning, the hippocampus did not store the place avoidance memory.     

Breakfast in the nook and dinner in the dining room: time-of-day discrimination in rats

Four studies were conducted which demonstrate that most (63%) male Sprague-Dawley rats can attain criterion, nine correct choices over ten consecutive trials, on a time-of-day discrimination in an elevated T-maze, but that the task is relatively difficult. The discrimination required that the rats go to one goal arm during a morning session and the other in an afternoon session. The sessions always began at the same time and were at least 6 h apart. A larger proportion of rats attained criterion and required fewer trials when the discriminative cue was a maze insert providing visual and tactile stimulation (0.72), orientation and position of the maze in the room (0.88), or the rats were required to always make the same left or right turn (0.94). Also, once criterion was attained, rats trained on time-of-day discrimination only made about 70% correct choices with continued training. Housing the rats with continuous light, all laboratory noises masked with white noise, and a random feeding schedule did not prevent them from acquiring the time-place discrimination. Testing the rats with a random number of trials during morning and afternoon sessions and with added or omitted sessions revealed that the rats did not use response or session alternation strategies to perform the discrimination. Also, the particular experimenter administering the morning or afternoon sessions did not serve as a cue for the discrimination. The relative difficulty of the task suggests that time of day does not normally function as a discriminative stimulus for choices, but probably as a contextual stimulus. Further, performance of the task in the absence of time-of-day cues suggests that the discrimination is based on event memory combined with an internal timing mechanism.     

Effects of ageing on allocentric and egocentric spatial strategies in the Wistar rat

This study was designed to assess the effect of ageing on spatial (allocentric and egocentric) strategies in rats. Two different tasks were designed for this purpose: one involving Morris' circular pool (distal extramaze cues) and another using the T water maze (egocentric cues). In the first task, the aged rats showed some difficulty in acquiring allocentric spatial learning skills. After increasing the number of trials in this task, there was no significant improvement in the performance of the aged group of rats compared to the adult group. However, in the second spatial task (using egocentric cues), both age groups gave a similar performance. Therefore, the effect of ageing on spatial learning depends on the strategy required to acquire this learning.     

Dahl (S × R) Rat Congenic Strain Analysis Confirms and Defines a Chromosome 17 Spatial Navigation Quantitative Trait Locus to <10 Mbp

A quantitative trait locus (QTL) linked with ability to find a platform in the Morris Water Maze (MWM) was located on chromosome 17 (Nav-5 QTL) using intercross between Dahl S and Dahl R rats. We developed two congenic strains, S.R17A and S.R17B introgressing Dahl R-chromosome 17 segments into Dahl S chromosome 17 region spanning putative Nav-5 QTL. Performance analysis of S.R17A, S.R17B and Dahl S rats in the Morris water maze (MWM) task showed a significantly decreased spatial navigation performance in S.R17B congenic rats when compared with Dahl S controls (P = 0.02). The S.R17A congenic segment did not affect MWM performance delimiting Nav-5 to the chromosome 17 65.02–74.66 Mbp region. Additional fine mapping is necessary to identify the specific gene variant accounting for Nav-5 effect on spatial learning and memory in Dahl rats.     

Use of cognitive strategies in rats: the role of estradiol and its interaction with dopamine

Accumulating evidence suggests a role for estrogen in the use of a particular cognitive strategy when solving a maze task. In order to confirm the role of estrogen in this phenomenon, ovariectomized (OVX) female rats receiving either high ( approximately 90 pg/ml) or low ( approximately 32 pg/ml) circulating levels of 17beta-estradiol benzoate (E2) performed a plus maze task for a reward. Consistent with previous research, OVX rats receiving low levels of E2 utilized a striatum-mediated response strategy while OVX rats administered high levels of E2 employed a hippocampus-mediated place strategy. Furthermore, following a systemic injection of a moderate dose of either a dopamine D1 (SKF 83566, 0.1 mg/kg IP) or D2 (raclopride, 0.5 mg/kg IP) receptor antagonist, low E2 rats were seen to use the opposite strategy and exercise a hippocampus-mediated place strategy in order to obtain the reward. At the same doses, high E2 rats did not change from using a place strategy. At a lower dose, these drugs shifted high E2 rats such that they showed an equal propensity for either strategy; this was not observed in low E2 rats. These results corroborate previous findings that E2 plays a significant role in the use of either a response or place strategy when solving a maze for a reward. In addition, the shift in strategy after dopamine receptor blockade implies the importance of central dopamine function in selecting a cognitive strategy to solve such tasks. It is suggested that estrogen alters cognitive strategy not only by improving hippocampal function, but also by altering dopamine-regulated striatal function.     

Sex and estrous cycle differences in immediate early gene activation in the hippocampus and the dorsal striatum after the cue competition task

The hippocampus and dorsal striatum are important structures involved in place and response learning strategies respectively. Both sex and estrous cycle phase differences in learning strategy preference exist following cue competition paradigms. Furthermore, significant effects of sex and learning strategy on hippocampal neural plasticity have been reported. However, associations between learning strategy and immediate early gene (IEG) expression in the hippocampus and dorsal striatum are not completely understood. In the current study we investigated the effects of sex and estrous cycle phase on strategy choice and IEG expression in the hippocampus and dorsal striatum of rats following cue competition training in the Morris water maze. We found that proestrous rats were more likely to choose a place strategy than non-proestrous or male rats. Although male cue strategy users travelled greater distances than the other groups on the first day of training, there were no other sex or strategy differences in the ability to reach a hidden or a visible platform. Female place strategy users exhibited greater zif268 expression and male place strategy users exhibited greater cFos expression compared to all other groups in CA3. Furthermore, cue strategy users had greater expression of cFos in the dorsal striatum than place strategy users. Shorter distances to reach a visible platform were associated with less activation of cFos in CA3 and CA1 of male place strategy users. Our findings indicate multiple differences in brain activation with sex and strategy use, despite limited behavioral differences between the sexes on this cue competition paradigm.     

Vasopressin analogues and spatial short-term memory in rats

The effect of vasopressin analogues on short-term memory was tested in the 12-arm radial maze. After the first 6 choices rats (n=6) were removed from the apparatus and allowed to complete the remaining 6 choices 20 min later. Whereas desgly-NH₂-VP, AVP, dAVP and DAVP (3.0 μ/kg) administered 40 min before or immediately after the first 6 choices did not change the incidence of errors in the second series of choices (2.0 errors under control conditions), similarly applied dDAVP deteriorated the rat's performance almost to the chance level of 3 errors. The significance of short-term memory tests for assessing the mnestic role of peptide hormones is stressed.     

Control of rodent and human spatial navigation by room and apparatus cues

A growing body of literature indicates that rats prefer to navigate in the direction of a goal in the environment (directional responding) rather than to the precise location of the goal (place navigation). This paper provides a brief review of this literature with an emphasis on recent findings in the Morris water task. Four experiments designed to extend this work to humans in a computerized, virtual Morris water task are also described. Special emphasis is devoted to how directional responding and place navigation are influenced by room and apparatus cues, and how these cues control distinct components of navigation to a goal. Experiments 1 and 2 demonstrate that humans, like rats, perform directional responses when cues from the apparatus are present, while Experiment 3 demonstrates that place navigation predominates when apparatus cues are eliminated. In Experiment 4, an eyetracking system measured gaze location in the virtual environment dynamically as participants navigated from a start point to the goal. Participants primarily looked at room cues during the early segment of each trial, but primarily focused on the apparatus as the trial progressed, suggesting distinct, sequential stimulus functions. Implications for computational modeling of navigation in the Morris water task and related tasks are discussed.     

The effect of binocular and monocular viewing conditions on performance of rats in the Morris water maze

The visually guided behaviour in the Morris water maze (using distal extramaze cues for navigation to a small invisible platform in a large pool of opaque water) was analyzed by comparing monocular and binocular performance of hooded rats in various versions of this task. A dish-shaped metal foil occluder connected to a carrier fixed to the frontal bones was used to restrict vision to one eye. Acquisition of the water maze task with one eye occluded proceeded at the same rate as with both eyes open. There was no difference in the transfer from binocular to monocular and from monocular to binocular viewing. Retrieval of the monocularly acquired habit was equally efficient with the same as with the contralateral eye. Similar results were obtained in naive and overtrained rats. In the working memory version of the task, rats received a single acquisition trial with a new position of the escape platform followed after a delay of 2, 5, 20 or 40 min by a single retrieval trial. Performance deteriorated with increasing delay faster under interocular transfer conditions then when the same eye was used in both trials. No signs of ocular dominance were found in this task. It is concluded that successful place learning is little affected by monocular or binocular viewing conditions, but that monocular impairment becomes apparent when the difficulty of the task is increased.     

Shifts in preferred learning strategy across the estrous cycle in female rats

The current status of the effects of ovarian steroids on learning and memory remains somewhat unclear, despite a large undertaking to evaluate these effects. What is emerging from this literature is that estrogen, and perhaps progesterone, influences learning and memory, but does so in a task-dependent manner. Previously, we have shown that ovariectomized rats given acute treatments of estrogen acquire allocentric or "place" tasks more easily than do rats deprived of estrogen, but acquire egocentric or "response" learning tasks more slowly than do those deprived of hormone, suggesting that estrogen treatment may bias the strategy a rat is able to use to solve tasks. To determine if natural fluctuations in ovarian hormones influence cognitive strategy, we tested whether strategy use fluctuated across the estrous cycle in reproductively intact female rats. We found that in two tasks in which rats freely choose the strategy used to solve the task, rats were more likely to use place strategies at proestrous, that is, when ovarian steroids are high. Conversely, estrous rats were biased toward response strategies. The data suggest that natural fluctuations in ovarian steroids may bias the neural system used and thus the cognitive strategies chosen during learning and memory.     

Performance of Young Children on ‘‘Traveling Salesperson’’ Navigation Tasks Presented on a Touch Screen

Background

The traveling salesperson problem (TSP) refers to a task in which one finds the shortest path when traveling through multiple spatially distributed points. Little is known about the developmental course of the strategies used to solve TSPs. The present study examined young children''s performance and route selection strategies in one-way TSPs using a city-block metric. A touch screen-based navigation task was applied.

Methodology/Principal Findings

Children (39–70 months) and adults (21–35 years) made serial responses on a touch screen to move a picture of a dog (the target) to two or three identical pictures of a bone (the goals). For all the versions of the tasks, significant improvement in measures of performance was observed from younger to older participants. In TSPs in which a specific route selection strategy such as the nearest-neighbor strategy minimized the total traveling distance, older participants used that strategy more frequently than younger ones. By contrast, in TSPs in which multiple strategies equally led to the minimal traveling distance, children tended to use strategies different from those used by adults, such as traveling straight to the farthest goal first.

Conclusions/Significance

The results primarily suggest development of efficient route selection strategies that can optimize total numbers of movements and/or solution time. Unlike adults, children sometimes prioritized other strategies such as traveling straight ahead until being forced to change directions. This may reflect the fact that children were either less attentive to the task or less efficient at perceiving the overall shape of the problem and/or the relative distance from the starting location to each goal.     

Parallel Representation of Value-Based and Finite State-Based Strategies in the Ventral and Dorsal Striatum

Previous theoretical studies of animal and human behavioral learning have focused on the dichotomy of the value-based strategy using action value functions to predict rewards and the model-based strategy using internal models to predict environmental states. However, animals and humans often take simple procedural behaviors, such as the “win-stay, lose-switch” strategy without explicit prediction of rewards or states. Here we consider another strategy, the finite state-based strategy, in which a subject selects an action depending on its discrete internal state and updates the state depending on the action chosen and the reward outcome. By analyzing choice behavior of rats in a free-choice task, we found that the finite state-based strategy fitted their behavioral choices more accurately than value-based and model-based strategies did. When fitted models were run autonomously with the same task, only the finite state-based strategy could reproduce the key feature of choice sequences. Analyses of neural activity recorded from the dorsolateral striatum (DLS), the dorsomedial striatum (DMS), and the ventral striatum (VS) identified significant fractions of neurons in all three subareas for which activities were correlated with individual states of the finite state-based strategy. The signal of internal states at the time of choice was found in DMS, and for clusters of states was found in VS. In addition, action values and state values of the value-based strategy were encoded in DMS and VS, respectively. These results suggest that both the value-based strategy and the finite state-based strategy are implemented in the striatum.