Crossmodal processing of object features in human anterior intraparietal cortex: an fMRI study implies equivalencies between humans and monkeys

The organization of macaque posterior parietal cortex (PPC) reflects its functional specialization in integrating polymodal sensory information for object recognition and manipulation. Neuropsychological and recent human imaging studies imply equivalencies between human and macaque PPC, and in particular, the cortex buried in the intraparietal sulcus (IPS). Using functional MRI, we tested the hypothesis that an area in human anterior intraparietal cortex is activated when healthy subjects perform a crossmodal visuo-tactile delayed matching-to-sample task with objects. Tactile or visual object presentation (encoding and recognition) both significantly activated anterior intraparietal cortex. As hypothesized, neural activity in this area was further enhanced when subjects transferred object information between modalities (crossmodal matching). Based on both the observed functional properties and the anatomical location, we suggest that this area in anterior IPS is the human equivalent of macaque area AIP.     

Evidence for the lateral intraparietal area as the parietal eye field.

It has long been appreciated that the posterior parietal cortex plays a role in the processing of saccadic eye movements. Only recently has it been discovered that a small cortical area, the lateral intraparietal area, within this much larger area appears to be specialized for saccadic eye movements. Unlike other cortical areas in the posterior parietal cortex, the lateral intraparietal area has strong anatomical connections to other saccade centers, and its cells have saccade-related responses that begin before the saccades. The lateral intraparietal area appears to be neither a strictly visual nor strictly motor structure; rather it performs visuomotor integration functions including determining the spatial location of saccade targets and forming plans to make eye movements.     

Spatial updating in human parietal cortex

Single neurons in monkey parietal cortex update visual information in conjunction with eye movements. This remapping of stimulus representations is thought to contribute to spatial constancy. We hypothesized that a similar process occurs in human parietal cortex and that we could visualize it with functional MRI. We scanned subjects during a task that involved remapping of visual signals across hemifields. We observed an initial response in the hemisphere contralateral to the visual stimulus, followed by a remapped response in the hemisphere ipsilateral to the stimulus. We ruled out the possibility that this remapped response resulted from either eye movements or visual stimuli alone. Our results demonstrate that updating of visual information occurs in human parietal cortex.     

Effects of Microstimulation in the Anterior Intraparietal Area during Three-Dimensional Shape Categorization

The anterior intraparietal area (AIP) of rhesus monkeys is part of the dorsal visual stream and contains neurons whose visual response properties are commensurate with a role in three-dimensional (3D) shape perception. Neuronal responses in AIP signal the depth structure of disparity-defined 3D shapes, reflect the choices of monkeys while they categorize 3D shapes, and mirror the behavioral variability across different stimulus conditions during 3D-shape categorization. However, direct evidence for a role of AIP in 3D-shape perception has been lacking. We trained rhesus monkeys to categorize disparity-defined 3D shapes and examined AIP''s contribution to 3D-shape categorization by microstimulating in clusters of 3D-shape selective AIP neurons during task performance. We find that microstimulation effects on choices (monkey M1) and reaction times (monkey M1 and M2) depend on the 3D-shape preference of the stimulated site. Moreover, electrical stimulation of the same cells, during either the 3D-shape-categorization task or a saccade task, could affect behavior differently. Interestingly, in one monkey we observed a strong correlation between the strength of choice-related AIP activity (choice probabilities) and the influence of microstimulation on 3D-shape-categorization behavior (choices and reaction time). These findings propose AIP as part of the network responsible for 3D-shape perception. The results also show that the anterior intraparietal cortex contains cells with different tuning properties, i.e. 3D-shape- or saccade-related, that can be dynamically read out depending on the requirements of the task at hand.     

Remapping for visual stability

Visual perception is based on both incoming sensory signals and information about ongoing actions. Recordings from single neurons have shown that corollary discharge signals can influence visual representations in parietal, frontal and extrastriate visual cortex, as well as the superior colliculus (SC). In each of these areas, visual representations are remapped in conjunction with eye movements. Remapping provides a mechanism for creating a stable, eye-centred map of salient locations. Temporal and spatial aspects of remapping are highly variable from cell to cell and area to area. Most neurons in the lateral intraparietal area remap stimulus traces, as do many neurons in closely allied areas such as the frontal eye fields the SC and extrastriate area V3A. Remapping is not purely a cortical phenomenon. Stimulus traces are remapped from one hemifield to the other even when direct cortico-cortical connections are removed. The neural circuitry that produces remapping is distinguished by significant plasticity, suggesting that updating of salient stimuli is fundamental for spatial stability and visuospatial behaviour. These findings provide new evidence that a unified and stable representation of visual space is constructed by redundant circuitry, comprising cortical and subcortical pathways, with a remarkable capacity for reorganization.     

Posterior Parietal Cortex Drives Inferotemporal Activations During Three-Dimensional Object Vision

The primate visual system consists of a ventral stream, specialized for object recognition, and a dorsal visual stream, which is crucial for spatial vision and actions. However, little is known about the interactions and information flow between these two streams. We investigated these interactions within the network processing three-dimensional (3D) object information, comprising both the dorsal and ventral stream. Reversible inactivation of the macaque caudal intraparietal area (CIP) during functional magnetic resonance imaging (fMRI) reduced fMRI activations in posterior parietal cortex in the dorsal stream and, surprisingly, also in the inferotemporal cortex (ITC) in the ventral visual stream. Moreover, CIP inactivation caused a perceptual deficit in a depth-structure categorization task. CIP-microstimulation during fMRI further suggests that CIP projects via posterior parietal areas to the ITC in the ventral stream. To our knowledge, these results provide the first causal evidence for the flow of visual 3D information from the dorsal stream to the ventral stream, and identify CIP as a key area for depth-structure processing. Thus, combining reversible inactivation and electrical microstimulation during fMRI provides a detailed view of the functional interactions between the two visual processing streams.     

Human Left Ventral Premotor Cortex Mediates Matching of Hand Posture to Object Use

Visuomotor transformations for grasping have been associated with a fronto-parietal network in the monkey brain. The human homologue of the parietal monkey region (AIP) has been identified as the anterior part of the intraparietal sulcus (aIPS), whereas the putative human equivalent of the monkey frontal region (F5) is located in the ventral part of the premotor cortex (vPMC). Results from animal studies suggest that monkey F5 is involved in the selection of appropriate hand postures relative to the constraints of the task. In humans, the functional roles of aIPS and vPMC appear to be more complex and the relative contribution of each region to grasp selection remains uncertain. The present study aimed to identify modulation in brain areas sensitive to the difficulty level of tool object - hand posture matching. Seventeen healthy right handed participants underwent fMRI while observing pictures of familiar tool objects followed by pictures of hand postures. The task was to decide whether the hand posture matched the functional use of the previously shown object. Conditions were manipulated for level of difficulty. Compared to a picture matching control task, the tool object – hand posture matching conditions conjointly showed increased modulation in several left hemispheric regions of the superior and inferior parietal lobules (including aIPS), the middle occipital gyrus, and the inferior temporal gyrus. Comparison of hard versus easy conditions selectively modulated the left inferior frontal gyrus with peak activity located in its opercular part (Brodmann area (BA) 44). We suggest that in the human brain, vPMC/BA44 is involved in the matching of hand posture configurations in accordance with visual and functional demands.     

Cortical neurons projecting to the posterior part of the superior temporal sulcus with particular reference to the posterior association area. An HRP study in the monkey

Corticocortical connections from the posterior association area to the posterior part of the superior temporal sulcal cortex (STs area) were studied in the monkey by means of retrograde axonal transport of horseradish peroxidase (HRP) or wheatgerm-agglutinin-conjugated HRP (WGA-HRP). After injecting 0.05-0.2 microliter of 50% HRP or 5% WGA-HRP into the STs area, labeled cells were examined in various cortical regions. The dorsal wall of the STs receives fibers mainly from the inferior parietal lobule (area 7) and superior temporal gyrus (area 22), whereas the ventral wall and floor part of the STs receive fibers from the posterior inferotemporal gyrus (area TEO) and prestriate cortex (areas 18 and 19). The deeper parts of the dorsal wall close to the floor region of the STs area also receive many fibers from the cortical walls surrounding the intraparietal, lunate and lateral sulci. Both the dorsal and ventral cortical walls of the intraparietal sulcus send fibers mainly to the deep dorsal wall of the STs. The ventral wall of the STs, on the other hand, receives fibers only from the ventral wall of the intraparietal sulcus. The medial surface of the prestriate cortex and the parahippocampal region send fibers to both walls of the STs. In the prestriate-STs projections originating from areas around the parieto-occipital sulcus, a topographic correlation is present; area 19 located anterior to the sulcus projects to the dorsal wall, whereas area 18 situated posterior to the sulcus projects to the ventral wall. Only the dorsal wall receives fibers from the cingulate (areas 23 and 24) and subparietal gyri (area 7). The deeper part of the dorsal wall and the ventral wall of the posterior STs area are interconnected with each other, while the upper part of the dorsal wall does not appear to receive fibers from the ventral wall.     

Parietal and hippocampal contribution to topokinetic and topographic memory.

This paper reviews the involvement of the parietal cortex and the hippocampus in three kinds of spatial memory tasks which all require a memory of a previously experienced movement in space. The first task compared, by means of positron emission tomography (PET) scan techniques, the production, in darkness, of self-paced saccades (SAC) with the reproduction, in darkness, of a previously learned sequence of saccades to visual targets (SEQ). The results show that a bilateral increase of activity was seen in the depth of the intraparietal sulcus and the medial superior parietal cortex (superior parietal gyrus and precuneus) together with the frontal sulcus but only in the SEQ task, which involved memory of the previously seen targets and possibly also motor memory. The second task is the vestibular memory contingent task, which requires that the subject makes, in darkness, a saccade to the remembered position of a visual target after a passively imposed whole-body rotation. Deficits in this task, which involves vestibular memory, were found predominantly in patients with focal vascular lesions in the parieto-insular (vestibular) cortex, the supplementary motor area-supplementary eye field area, and the prefrontal cortex. The third task requires mental navigation from the memory of a previously learned route in a real environment (the city of Orsay in France). A PET scan study has revealed that when subjects were asked to remember visual landmarks there was a bilateral activation of the middle hippocampal regions, left inferior temporal gyrus, left hippocampal regions, precentral gyrus and posterior cingulate gyrus. If the subjects were asked to remember the route, and their movements along this route, bilateral activation of the dorsolateral cortex, posterior hippocampal areas, posterior cingulate gyrus, supplementary motor areas, right middle hippocampal areas, left precuneus, middle occipital gyrus, fusiform gyrus and lateral premotor area was found. Subtraction between the two conditions reduced the activated areas to the left hippocampus, precuneus and insula. These data suggest that the hippocampus and parietal cortex are both involved in the dynamic aspects of spatial memory, for which the name ''topokinetic memory'' is proposed. These dynamic aspects could both overlap and be different from those involved in the cartographic and static aspects of ''topographic'' memory.     

Proprioceptive alignment of visual and somatosensory maps in the posterior parietal cortex

A touch on one hand can enhance the response to a visual stimulus delivered at a nearby location [1, 2], improving our interactions with the external world. In order to keep such visual-tactile spatial interactions effective, the brain updates the continuous postural changes, like those typically accompanying hand actions, through proprioception, thus maintaining the somatosensory and visual maps in spatial register [2, 3]. The posterior parietal cortex (PPC) might be critical for such a spatial remapping [4]; nevertheless, a direct causal demonstration of its involvement is lacking. Here, we found that unattended touches to one hand enhanced visual sensitivity for phosphenes induced by occipital trancranial magnetic stimulation (TMS) [5] when the touched hand was spatially coincident to the reported location of the phosphenes in external space. Notably, this spatially specific crossmodal facilitation was maintained after hand crossing, suggesting an efficient visual-tactile remapping. Critically, after 1 Hz repetitive TMS interference [6] over the PPC, but not over the primary somatosensory cortex, phosphene detection was still enhanced by spatially coincident touches with uncrossed hands, but it was enhanced by spatially noncoincident touches after hand crossing. This is the first causal evidence in humans that the PPC constantly updates the representation of the body in space in order to facilitate crossmodal interactions.     

Functional magnetic resonance imaging of macaque monkeys performing visually guided saccade tasks: comparison of cortical eye fields with humans

The frontal and parietal eye fields serve as functional landmarks of the primate brain, although their correspondences between humans and macaque monkeys remain unclear. We conducted fMRI at 4.7 T in monkeys performing visually-guided saccade tasks and compared brain activations with those in humans using identical paradigms. Among multiple parietal activations, the dorsal lateral intraparietal area in monkeys and an area in the posterior superior parietal lobule in humans exhibited the highest selectivity to saccade directions. In the frontal cortex, the selectivity was highest at the junction of the precentral and superior frontal sulci in humans and in the frontal eye field (FEF) in monkeys. BOLD activation peaks were also found in premotor areas (BA6) in monkeys, which suggests that the apparent discrepancy in location between putative human FEF (BA6, suggested by imaging studies) and monkey FEF (BA8, identified by microstimulation studies) partly arose from methodological differences.     

Maps of space in human frontoparietal cortex

Prefrontal cortex (PFC) and posterior parietal cortex (PPC) are neural substrates for spatial cognition. We here review studies in which we tested the hypothesis that human frontoparietal cortex may function as a priority map. According to priority map theory, objects or locations in the visual world are represented by neural activity that is proportional to their attentional priority. Using functional magnetic resonance imaging (fMRI), we first identified topographic maps in PFC and PPC as candidate priority maps of space. We then measured fMRI activity in candidate priority maps during the delay periods of a covert attention task, a spatial working memory task, and a motor planning task to test whether the activity depended on the particular spatial cognition. Our hypothesis was that some, but not all, candidate priority maps in PFC and PPC would be agnostic with regard to what was being prioritized, in that their activity would reflect the location in space across tasks rather than a particular kind of spatial cognition (e.g., covert attention). To test whether patterns of delay period activity were interchangeable during the spatial cognitive tasks, we used multivariate classifiers. We found that decoders trained to predict the locations on one task (e.g., working memory) cross-predicted the locations on the other tasks (e.g., covert attention and motor planning) in superior precentral sulcus (sPCS) and in a region of intraparietal sulcus (IPS2), suggesting that these patterns of maintenance activity may be interchangeable across the tasks. Such properties make sPCS in frontal cortex and IPS2 in parietal cortex viable priority map candidates, and suggest that these areas may be the human homologs of the monkey frontal eye field (FEF) and lateral intraparietal area (LIP).     

Neural coding of 3D features of objects for hand action in the parietal cortex of the monkey.

In our previous studies of hand manipulation task-related neurons, we found many neurons of the parietal association cortex which responded to the sight of three-dimensional (3D) objects. Most of the task-related neurons in the AIP area (the lateral bank of the anterior intraparietal sulcus) were visually responsive and half of them responded to objects for manipulation. Most of these neurons were selective for the 3D features of the objects. More recently, we have found binocular visual neurons in the lateral bank of the caudal intraparietal sulcus (c-IPS area) that preferentially respond to a luminous bar or place at a particular orientation in space. We studied the responses of axis-orientation selective (AOS) neurons and surface-orientation selective (SOS) neurons in this area with stimuli presented on a 3D computer graphics display. The AOS neurons showed a stronger response to elongated stimuli and showed tuning to the orientation of the longitudinal axis. Many of them preferred a tilted stimulus in depth and appeared to be sensitive to orientation disparity and/or width disparity. The SOS neurons showed a stronger response to a flat than to an elongated stimulus and showed tuning to the 3D orientation of the surface. Their responses increased with the width or length of the stimulus. A considerable number of SOS neurons responded to a square in a random dot stereogram and were tuned to orientation in depth, suggesting their sensitivity to the gradient of disparity. We also found several SOS neurons that responded to a square with tilted or slanted contours, suggesting their sensitivity to orientation disparity and/or width disparity. Area c-IPS is likely to send visual signals of the 3D features of an object to area AIP for the visual guidance of hand actions.     

Gaze control: role of the parietal cortex

Eye movements constitute one of the most basic means of interacting with our environment, allowing to orient to, localize and scrutinize the variety of potentially interesting objects that surround us. In this review we discuss the role of the parietal cortex in the control of saccadic and smooth pursuit eye movements, whose purpose is to rapidly displace the line of gaze and to maintain a moving object on the central retina, respectively. From single cell recording studies in monkey we know that distinct sub-regions of the parietal lobe are implicated in these two kinds of movement. The middle temporal (MT) and medial superior temporal (MST) areas show neuronal activities related to moving visual stimuli and to ocular pursuit. The lateral intraparietal (LIP) area exhibits visual and saccadic neuronal responses. Electrophysiology, which in essence is a correlation method, cannot entirely solve the question of the functional implication of these areas: are they primarily involved in sensory processing, in motor processing, or in some intermediate function? Lesion approaches (reversible or permanent) in the monkey can provide important information in this respect. Lesions of MT or MST produce deficits in the perception of visual motion, which would argue for their possible role in sensory guidance of ocular pursuit rather than in directing motor commands to the eye muscle. Lesions of LIP do not produce specific visual impairments and cause only subtle saccadic deficits. However, recent results have shown the presence of severe deficits in spatial attention tasks. LIP could thus be implicated in the selection of relevant objects in the visual scene and provide a signal for directing the eyes toward these objects. Functional imaging studies in humans confirm the role of the parietal cortex in pursuit, saccadic, and attentional networks, and show a high degree of overlap with monkey data. Parietal lobe lesions in humans also result in behavioral deficits very similar to those that are observed in the monkey. Altogether, these different sources of data consistently point to the involvement of the parietal cortex in the representation of space, at an intermediate stage between vision and action.     

Parietal control of hand action

Recent advances suggest that neurons of the anterior intraparietal area play a critical role in the visual guidance of hand action. The parietal cortex appears to process in-coming binocular visual signals of the three-dimensional features of objects and matches these signals with the motor signals, which come from the ventral premotor cortex, that will be required for hand manipulation of the object.     

Polymodal motion processing in posterior parietal and premotor cortex: a human fMRI study strongly implies equivalencies between humans and monkeys

In monkeys, posterior parietal and premotor cortex play an important integrative role in polymodal motion processing. In contrast, our understanding of the convergence of senses in humans is only at its beginning. To test for equivalencies between macaque and human polymodal motion processing, we used functional MRI in normals while presenting moving visual, tactile, or auditory stimuli. Increased neural activity evoked by all three stimulus modalities was found in the depth of the intraparietal sulcus (IPS), ventral premotor, and lateral inferior postcentral cortex. The observed activations strongly suggest that polymodal motion processing in humans and monkeys is supported by equivalent areas. The activations in the depth of IPS imply that this area constitutes the human equivalent of macaque area VIP.     

Distinct Parietal and Temporal Pathways to the Homologues of Broca's Area in the Monkey

The homologues of the two distinct architectonic areas 44 and 45 that constitute the anterior language zone (Broca's region) in the human ventrolateral frontal lobe were recently established in the macaque monkey. Although we know that the inferior parietal lobule and the lateral temporal cortical region project to the ventrolateral frontal cortex, we do not know which of the several cortical areas found in those regions project to the homologues of Broca's region in the macaque monkey and by means of which white matter pathways. We have used the autoradiographic method, which permits the establishment of the cortical area from which axons originate (i.e., the site of injection), the precise course of the axons in the white matter, and their termination within particular cortical areas, to examine the parietal and temporal connections to area 44 and the two subdivisions of area 45 (i.e., areas 45A and 45B). The results demonstrated a ventral temporo-frontal stream of fibers that originate from various auditory, multisensory, and visual association cortical areas in the intermediate superolateral temporal region. These axons course via the extreme capsule and target most strongly area 45 with a more modest termination in area 44. By contrast, a dorsal stream of axons that originate from various cortical areas in the inferior parietal lobule and the adjacent caudal superior temporal sulcus was found to target both areas 44 and 45. These axons course in the superior longitudinal fasciculus, with some axons originating from the ventral inferior parietal lobule and the adjacent superior temporal sulcus arching and forming a simple arcuate fasciculus. The cortex of the most rostral part of the inferior parietal lobule is preferentially linked with the ventral premotor cortex (ventral area 6) that controls the orofacial musculature. The cortex of the intermediate part of the inferior parietal lobule is linked with both areas 44 and 45. These findings demonstrate the posterior parietal and temporal connections of the ventrolateral frontal areas, which, in the left hemisphere of the human brain, were adapted for various aspects of language production. These precursor circuits that are found in the nonlinguistic, nonhuman, primate brain also exist in the human brain. The possible reasons why these areas were adapted for language use in the human brain are discussed. The results throw new light on the prelinguistic precursor circuitry of Broca's region and help understand functional interactions between Broca's ventrolateral frontal region and posterior parietal and temporal association areas.     

Posterior parietal cortex neurons encode target motion in world-centered coordinates

The motion areas of posterior parietal cortex extract information on visual motion for perception as well as for the guidance of movement. It is usually assumed that neurons in posterior parietal cortex represent visual motion relative to the retina. Current models describing action guided by moving objects work successfully based on this assumption. However, here we show that the pursuit-related responses of a distinct group of neurons in area MST of monkeys are at odds with this view. Rather than signaling object image motion on the retina, they represent object motion in world-centered coordinates. This representation may simplify the coordination of object-directed action and ego motion-invariant visual perception.     

The Importance of Lateral Connections in the Parietal Cortex for Generating Motor Plans

Substantial evidence has highlighted the significant role of associative brain areas, such as the posterior parietal cortex (PPC) in transforming multimodal sensory information into motor plans. However, little is known about how different sensory information, which can have different delays or be absent, combines to produce a motor plan, such as executing a reaching movement. To address these issues, we constructed four biologically plausible network architectures to simulate PPC: 1) feedforward from sensory input to the PPC to a motor output area, 2) feedforward with the addition of an efference copy from the motor area, 3) feedforward with the addition of lateral or recurrent connectivity across PPC neurons, and 4) feedforward plus efference copy, and lateral connections. Using an evolutionary strategy, the connectivity of these network architectures was evolved to execute visually guided movements, where the target stimulus provided visual input for the entirety of each trial. The models were then tested on a memory guided motor task, where the visual target disappeared after a short duration. Sensory input to the neural networks had sensory delays consistent with results from monkey studies. We found that lateral connections within the PPC resulted in smoother movements and were necessary for accurate movements in the absence of visual input. The addition of lateral connections resulted in velocity profiles consistent with those observed in human and non-human primate visually guided studies of reaching, and allowed for smooth, rapid, and accurate movements under all conditions. In contrast, Feedforward or Feedback architectures were insufficient to overcome these challenges. Our results suggest that intrinsic lateral connections are critical for executing accurate, smooth motor plans.     

A deficit in covert attention after parietal cortex inactivation in the monkey

Although the parietal cortex has been repeatedly implicated in controlling attention, the nature and importance of this contribution remain unclear. Here we show that inactivating the lateral intraparietal area in monkeys delays the detection of a visual target located in the contralateral visual field. This effect was observed using different visual scene configurations, e.g., with distractors that differ in number or that differ from the target by a conjunction of shape and color or by a single feature. Since eye movements were not allowed during the searching tasks, these results argue for an unambiguous role of the parietal cortex in the top-down control of attentional deployment in space.