Grids in Topographic Maps Reduce Distortions in the Recall of Learned Object Locations

To date, it has been shown that cognitive map representations based on cartographic visualisations are systematically distorted. The grid is a traditional element of map graphics that has rarely been considered in research on perception-based spatial distortions. Grids do not only support the map reader in finding coordinates or locations of objects, they also provide a systematic structure for clustering visual map information (“spatial chunks”). The aim of this study was to examine whether different cartographic kinds of grids reduce spatial distortions and improve recall memory for object locations. Recall performance was measured as both the percentage of correctly recalled objects (hit rate) and the mean distance errors of correctly recalled objects (spatial accuracy). Different kinds of grids (continuous lines, dashed lines, crosses) were applied to topographic maps. These maps were also varied in their type of characteristic areas (LANDSCAPE) and different information layer compositions (DENSITY) to examine the effects of map complexity. The study involving 144 participants shows that all experimental cartographic factors (GRID, LANDSCAPE, DENSITY) improve recall performance and spatial accuracy of learned object locations. Overlaying a topographic map with a grid significantly reduces the mean distance errors of correctly recalled map objects. The paper includes a discussion of a square grid''s usefulness concerning object location memory, independent of whether the grid is clearly visible (continuous or dashed lines) or only indicated by crosses.     

When do objects become landmarks? A VR study of the effect of task relevance on spatial memory

We investigated how objects come to serve as landmarks in spatial memory, and more specifically how they form part of an allocentric cognitive map. Participants performing a virtual driving task incidentally learned the layout of a virtual town and locations of objects in that town. They were subsequently tested on their spatial and recognition memory for the objects. To assess whether the objects were encoded allocentrically we examined pointing consistency across tested viewpoints. In three experiments, we found that spatial memory for objects at navigationally relevant locations was more consistent across tested viewpoints, particularly when participants had more limited experience of the environment. When participants' attention was focused on the appearance of objects, the navigational relevance effect was eliminated, whereas when their attention was focused on objects' locations, this effect was enhanced, supporting the hypothesis that when objects are processed in the service of navigation, rather than merely being viewed as objects, they engage qualitatively distinct attentional systems and are incorporated into an allocentric spatial representation. The results are consistent with evidence from the neuroimaging literature that when objects are relevant to navigation, they not only engage the ventral "object processing stream", but also the dorsal stream and medial temporal lobe memory system classically associated with allocentric spatial memory.     

Reconciling neuronal representations of schema,abstract task structure,and categorization under cognitive maps in the entorhinal-hippocampal-frontal circuits

Learning leads to a neuronal representation of acquired knowledge. This idea of knowledge representation was traditionally developed as a “cognitive map” of spatial memory represented in the hippocampus. The framework of cognitive mapping has been extended in the past decade to include not only spatial memory, but also non-spatial factual and temporal memory. Following this conceptual advancement, a line of recent neurophysiological research discovered such knowledge representations not only in the hippocampus, but also in the entorhinal cortex and frontal cortex. Although the distinct terms “cognitive map,” “schema,” “abstract task structure” or “categorization” were used in these studies, it is likely that these terms can be reconciled as a common mechanism of learned knowledge representations. Future experimental work will be required to differentiate the parametric nature of knowledge representations across brain areas.     

Distinct Visual Working Memory Systems for View-Dependent and View-Invariant Representation

Background

How do people sustain a visual representation of the environment? Currently, many researchers argue that a single visual working memory system sustains non-spatial object information such as colors and shapes. However, previous studies tested visual working memory for two-dimensional objects only. In consequence, the nature of visual working memory for three-dimensional (3D) object representation remains unknown.

Methodology/Principal Findings

Here, I show that when sustaining information about 3D objects, visual working memory clearly divides into two separate, specialized memory systems, rather than one system, as was previously thought. One memory system gradually accumulates sensory information, forming an increasingly precise view-dependent representation of the scene over the course of several seconds. A second memory system sustains view-invariant representations of 3D objects. The view-dependent memory system has a storage capacity of 3–4 representations and the view-invariant memory system has a storage capacity of 1–2 representations. These systems can operate independently from one another and do not compete for working memory storage resources.

Conclusions/Significance

These results provide evidence that visual working memory sustains object information in two separate, specialized memory systems. One memory system sustains view-dependent representations of the scene, akin to the view-specific representations that guide place recognition during navigation in humans, rodents and insects. The second memory system sustains view-invariant representations of 3D objects, akin to the object-based representations that underlie object cognition.     

Distributed neural systems for the generation of visual images

Visual perception of houses, faces, and chairs evoke differential responses in ventral temporal cortex. Using fMRI, we compared activations evoked by perception and imagery of these object categories. We found content-related activation during imagery in extrastriate cortex, but this activity was restricted to small subsets of the regions that showed category-related activation during perception. Within ventral temporal cortex, activation during imagery evoked stronger responses on the left whereas perception evoked stronger responses on the right. Additionally, visual imagery evoked activity in parietal and frontal cortex, but this activity was not content related. These results suggest that content-related activation during imagery in visual extrastriate cortex may be implemented by "top-down" mechanisms in parietal and frontal cortex that mediate the retrieval of face and object representations from long-term memory and their maintenance through visual imagery.     

The Time Course of Activation of Object Shape and Shape+Colour Representations during Memory Retrieval

Little is known about the timing of activating memory for objects and their associated perceptual properties, such as colour, and yet this is important for theories of human cognition. We investigated the time course associated with early cognitive processes related to the activation of object shape and object shape+colour representations respectively, during memory retrieval as assessed by repetition priming in an event-related potential (ERP) study. The main findings were as follows: (1) we identified a unique early modulation of mean ERP amplitude during the N1 that was associated with the activation of object shape independently of colour; (2) we also found a subsequent early P2 modulation of mean amplitude over the same electrode clusters associated with the activation of object shape+colour representations; (3) these findings were apparent across both familiar (i.e., correctly coloured – yellow banana) and novel (i.e., incorrectly coloured - blue strawberry) objects; and (4) neither of the modulations of mean ERP amplitude were evident during the P3. Together the findings delineate the timing of object shape and colour memory systems and support the notion that perceptual representations of object shape mediate the retrieval of temporary shape+colour representations for familiar and novel objects.     

Functional connectivity models for decoding of spatial representations from hippocampal CA1 recordings

Hippocampus stores spatial representations, or maps, which are recalled each time a subject is placed in the corresponding environment. Across different environments of similar geometry, these representations show strong orthogonality in CA3 of hippocampus, whereas in the CA1 subfield a considerable overlap between the maps can be seen. The lower orthogonality decreases reliability of various decoders developed in an attempt to identify which of the stored maps is active at the moment. Especially, the problem with decoding emerges with a need to analyze data at high temporal resolution. Here, we introduce a functional-connectivity-based decoder, which accounts for the pairwise correlations between the spiking activities of neurons in each map and does not require any positional information, i.e. any knowledge about place fields. We first show, on recordings of hippocampal activity in constant environmental conditions, that our decoder outperforms existing decoding methods in CA1. Our decoder is then applied to data from teleportation experiments, in which an instantaneous switch between the environment identity triggers a recall of the corresponding spatial representation . We test the sensitivity of our approach on the transition dynamics between the respective memory states (maps). We find that the rate of spontaneous state shifts (flickering) after a teleportation event is increased not only within the first few seconds as already reported, but this instability is sustained across much longer (> 1 min.) periods.     

The electro-dynamics of the dendritic space in Purkinje cells of the cerebellum

The functional geometry of the reconstructed dendritic arborization of Purkinje neurons is the object of this work. The combined effects of the local geometry of the dendritic branches and of the membrane mechanisms are computed in passive configuration to obtain the electrotonic structure of the arborization. Steady-currents applied to the soma and expressed as a function of the path distance from the soma form different clusters of profiles in which dendritic branches are similar in voltages and current transfer effectiveness. The locations of the different clusters are mapped on the dendrograms and 3D representations of the arborization. It reveals the presence of different spatial dendritic sectors clearly separated in 3D space that shape the arborization in ordered electrical domains, each with similar passive charge transfer efficiencies. Further simulations are performed in active configuration with a realistic cocktail of conductances to find out whether similar spatial domains found in the passive model also characterize the active dendritic arborization. During tonic activation of excitatory synaptic inputs homogeneously distributed over the whole arborization, the Purkinje cell generates regular oscillatory potentials. The temporal patterns of the electrical oscillations induce similar spatial sectors in the arborization as those observed in the passive electrotonic structure. By taking a video of the dendritic maps of the membrane potentials during a single oscillation, we demonstrate that the functional dendritic field of a Purkinje neuron displays dynamic changes which occur in the spatial distribution of membrane potentials in the course of the oscillation. We conclude that the branching pattern of the arborization explains such continuous reconfiguration and discuss its functional implications.     

A common frame of reference for learned and communicated vectors in honeybee navigation

Humans draw maps when communicating about places or verbally describe routes between locations. Honeybees communicate places by encoding distance and direction in their waggle dances. Controversy exists not only about the structure of spatial memory but also about the efficiency of dance communication. Some of these uncertainties were resolved by studies in which recruits' flights were monitored using harmonic radar. We asked whether the two sources of vector information--the previously learned flight vector to a food source and the communicated vector--are represented in a common frame of spatial reference. We found that recruits redirect their outbound flights and perform novel shortcut flights between the communicated and learned locations in both directions. Guidance by beacons at the respective locations or by the panorama of the horizon was excluded. These findings indicate a spatial reference based on either large-scale vector integration or a common geocentric map-like spatial memory. Both models predict a memory structure that stores the spatial layout in such a way that decisions are made according to estimated distances and directions. The models differ with respect to the role of landmarks and the time of learning of spatial relations.     

Short-range orientation in fish: How fish map space

One way in which fish can move around efficiently is to learn and remember a spatial map of their environment. This can be a relatively simple process where, for example, sequences of landmarks are learned. However, more complex spatial representations can be generated by integrating multiple pieces of information. In this review, we consider what types of information fish use to generate a spatial map; for instance, beacons (single landmarks) that signal a specific location, or learned geometric relationships between multiple landmarks that allow fish to guide their movements. Owing to the diversity of fish species and the broad range of environments that they inhabit, there is considerable diversity in the maps that they develop and the sensory systems that they use to detect spatial information. This chapter uses a series of examples to investigate the types of spatial information that fish encode, for instance, how they map three-dimensional space, how they make use of different sensory modalities, and where this information might be processed. We also highlight the versatility of short-range orientation in fish, and discuss a number of similarities between the mapping mechanisms used by fish and terrestrial vertebrates.     

Evidence for a specific internal representation of motion–force relationships during object manipulation

 Human subjects learned a tracking task which required them to point at a moving target with the free end of an inverted pendulum object. In order to determine how subjects represented this object internally, we studied learning interference between variants of this task in which the pendulum object had either stable or unstable dynamics. Using a novel method, agreement between possible internal representations of the two tasks was estimated by analysis of the motion-to-torque relationships experienced by each subject as they manipulated each object. It was possible to predict retention of the primary task on day 2 from our measure of agreement between primary and interfering tasks on day 1. This result suggests that the subjects learned the correct torque patterns to use to produce specific desired patterns of motion as they learned the balancing task. Surprisingly, the analyses indicate that retention was not impaired when similar motions of the two objects required retrieval of incompatible torque responses, but retention was impaired when similar patterns of motion in the two tasks required similar patterns of applied torque. These findings can be accounted for by a simple model of how multiple similar torque responses are selected and retrieved from memory when responses are freely chosen. Received: 20 December 2001 / Accepted in revised form: 25 July 2002 Correspondence to: C. D. Mah (e-mail: c-mah@northwestern.edu)     

A self-organizing multiple-view representation of 3D objects

We explore representation of 3D objects in which several distinct 2D views are stored for each object. We demonstrate the ability of a two-layer network of thresholded summation units to support such representations. Using unsupervised Hebbian relaxation, the network learned to recognize ten objects from different viewpoints. The training process led to the emergence of compact representations of the specific input views. When tested on novel views of the same objects, the network exhibited a substantial generalization capability. In simulated psychophysical experiments, the network's behavior was qualitatively similar to that of human subjects.     

The Impact of Symbolic and Non-Symbolic Quantity on Spatial Learning

An implicit mapping of number to space via a “mental number line” occurs automatically in adulthood. Here, we systematically explore the influence of differing representations of quantity (no quantity, non-symbolic magnitudes, and symbolic numbers) and directional flow of stimuli (random flow, left-to-right, or right-to-left) on learning and attention via a match-to-sample working memory task. When recalling a cognitively demanding string of spatial locations, subjects performed best when information was presented right-to-left. When non-symbolic or symbolic numerical arrays were embedded in these spatial locations, and mental number line congruency prompted, this effect was attenuated and in some cases reversed. In particular, low-performing female participants who viewed increasing non-symbolic number arrays paired with the spatial locations exhibited better recall for left-to-right directional flow information relative to right-to-left, and better processing for the left side of space relative to the right side of space. The presence of symbolic number during spatial learning enhanced recall to a greater degree than non-symbolic number—especially for female participants, and especially when cognitive load is high—and this difference was independent of directional flow of information. We conclude that quantity representations have the potential to scaffold spatial memory, but this potential is subtle, and mediated by the nature of the quantity and the gender and performance level of the learner.     

A role for central nervous growth hormone-releasing hormone signaling in the consolidation of declarative memories

Contributions of somatotropic hormonal activity to memory functions in humans, which are suggested by clinical observations, have not been systematically examined. With previous experiments precluding a direct effect of systemic growth hormone (GH) on acute memory formation, we assessed the role of central nervous somatotropic signaling in declarative memory consolidation. We examined the effect of intranasally administered growth hormone releasing-hormone (GHRH; 600 μg) that has direct access to the brain and suppresses endogenous GHRH via an ultra-short negative feedback loop. Twelve healthy young men learned word-pair associates at 2030 h and were administered GHRH and placebo, respectively, at 2100 h. Retrieval was tested after 11 hours of wakefulness. Compared to placebo, intranasal GHRH blunted GH release within 3 hours after substance administration and reduced the number of correctly recalled word-pairs by ～12% (both P<0.05). The impairment of declarative memory consolidation was directly correlated to diminished GH concentrations (P<0.05). Procedural memory consolidation as examined by the parallel assessment of finger sequence tapping performance was not affected by GHRH administration. Our findings indicate that intranasal GHRH, by counteracting endogenous GHRH release, impairs hippocampal memory processing. They provide first evidence for a critical contribution of central nervous somatotropic activity to hippocampus-dependent memory consolidation.     

Defining the stimulus—A memoir

The eminent psychophysicist, S.S. Stevens, once remarked that, “the basic problem of psychology was the definition of the stimulus” (Stevens, 1951, p. 46). By expanding the traditional definition of the stimulus, the study of animal learning has metamorphosed into animal cognition. The main impetus for that change was the recognition that it is often necessary to postulate a representation between the traditional S and R of learning theory. Representations allow a subject to represent a stimulus it learned previously that is currently absent. Thus, in delayed matching-to-sample, one has to assume that a subject responds to a representation of the sample during test if it responds correctly. Other examples, to name but a few, include concept formation, spatial memory, serial memory, learning a numerical rule, imitation and metacognition. Whereas a representation used to be regarded as a mentalistic phenomenon that was unworthy of scientific inquiry, it can now be operationally defined. To accommodate representations, the traditional discriminative stimulus has to be expanded to allow for the role of representations. The resulting composite can account for a significantly larger portion of the variance of performance measures than the exteroceptive stimulus could by itself.     

Dissociating the Neural Correlates of Intra-Item and Inter-Item Working-Memory Binding

Background

Integration of information streams into a unitary representation is an important task of our cognitive system. Within working memory, the medial temporal lobe (MTL) has been conceptually linked to the maintenance of bound representations. In a previous fMRI study, we have shown that the MTL is indeed more active during working-memory maintenance of spatial associations as compared to non-spatial associations or single items. There are two explanations for this result, the mere presence of the spatial component activates the MTL, or the MTL is recruited to bind associations between neurally non-overlapping representations.

Methodology/Principal Findings

The current fMRI study investigates this issue further by directly comparing intrinsic intra-item binding (object/colour), extrinsic intra-item binding (object/location), and inter-item binding (object/object). The three binding conditions resulted in differential activation of brain regions. Specifically, we show that the MTL is important for establishing extrinsic intra-item associations and inter-item associations, in line with the notion that binding of information processed in different brain regions depends on the MTL.

Conclusions/Significance

Our findings indicate that different forms of working-memory binding rely on specific neural structures. In addition, these results extend previous reports indicating that the MTL is implicated in working-memory maintenance, challenging the classic distinction between short-term and long-term memory systems.     

Generalization of Dexterous Manipulation Is Sensitive to the Frame of Reference in Which It Is Learned

Studies have shown that internal representations of manipulations of objects with asymmetric mass distributions that are generated within a specific orientation are not generalizable to novel orientations, i.e., subjects fail to prevent object roll on their first grasp-lift attempt of the object following 180° object rotation. This suggests that representations of these manipulations are specific to the reference frame in which they are formed. However, it is unknown whether that reference frame is specific to the hand, the body, or both, because rotating the object 180° modifies the relation between object and body as well as object and hand. An alternative, untested explanation for the above failure to generalize learned manipulations is that any rotation will disrupt grasp performance, regardless if the reference frame in which the manipulation was learned is maintained or modified. We examined the effect of rotations that (1) maintain and (2) modify relations between object and body, and object and hand, on the generalizability of learned two-digit manipulation of an object with an asymmetric mass distribution. Following rotations that maintained the relation between object and body and object and hand (e.g., rotating the object and subject 180°), subjects continued to use appropriate digit placement and load force distributions, thus generating sufficient compensatory moments to minimize object roll. In contrast, following rotations that modified the relation between (1) object and hand (e.g. rotating the hand around to the opposite object side), (2) object and body (e.g. rotating subject and hand 180°), or (3) both (e.g. rotating the subject 180°), subjects used the same, yet inappropriate digit placement and load force distribution, as those used prior to the rotation. Consequently, the compensatory moments were insufficient to prevent large object rolls. These findings suggest that representations of learned manipulation of objects with asymmetric mass distributions are specific to the body- and hand-reference frames in which they were learned.     

Learning invariant object recognition in the visual system with continuous transformations

The cerebral cortex utilizes spatiotemporal continuity in the world to help build invariant representations. In vision, these might be representations of objects. The temporal continuity typical of objects has been used in an associative learning rule with a short-term memory trace to help build invariant object representations. In this paper, we show that spatial continuity can also provide a basis for helping a system to self-organize invariant representations. We introduce a new learning paradigm “continuous transformation learning” which operates by mapping spatially similar input patterns to the same postsynaptic neurons in a competitive learning system. As the inputs move through the space of possible continuous transforms (e.g. translation, rotation, etc.), the active synapses are modified onto the set of postsynaptic neurons. Because other transforms of the same stimulus overlap with previously learned exemplars, a common set of postsynaptic neurons is activated by the new transforms, and learning of the new active inputs onto the same postsynaptic neurons is facilitated. We demonstrate that a hierarchical model of cortical processing in the ventral visual system can be trained with continuous transform learning, and highlight differences in the learning of invariant representations to those achieved by trace learning.     

Dynamic decorrelation as a unifying principle for explaining a broad range of brightness phenomena

The visual system is highly sensitive to spatial context for encoding luminance patterns. Context sensitivity inspired the proposal of many neural mechanisms for explaining the perception of luminance (brightness). Here we propose a novel computational model for estimating the brightness of many visual illusions. We hypothesize that many aspects of brightness can be explained by a dynamic filtering process that reduces the redundancy in edge representations on the one hand, while non-redundant activity is enhanced on the other. The dynamic filter is learned for each input image and implements context sensitivity. Dynamic filtering is applied to the responses of (model) complex cells in order to build a gain control map. The gain control map then acts on simple cell responses before they are used to create a brightness map via activity propagation. Our approach is successful in predicting many challenging visual illusions, including contrast effects, assimilation, and reverse contrast with the same set of model parameters.     

Egocentric Representation Acquired from Offline Map Learning

It is widely accepted that people establish allocentric spatial representation after learning a map. However, it is unknown whether people can directly acquire egocentric representation after map learning. In two experiments, the participants learned a distal environment through a map and then performed the egocentric pointing tasks in that environment under three conditions: with the heading aligned with the learning perspective (baseline), after 240° rotation from the baseline (updating), and after disorientation (disorientation). Disorientation disrupted the internal consistency of pointing among objects when the participants learned the sequentially displayed map, on which only one object name was displayed at a time while the location of “self” remained on the screen all the time. However, disorientation did not affect the internal consistency of pointing among objects when the participants learned the simultaneously displayed map. These results suggest that the egocentric representation can be acquired from a sequentially presented map.