Sensory and behavioral properties of neurons in posterior parietal cortex of the awake, trained monkey.

Neurons in posterior parietal cortex of the awake, trained monkey respond to passive visual and/or somatosensory stimuli. In general, the receptive fields of these cells are large and nonspecific. When these neurons are studied during visually guided hand movements and eye movements, most of their activity can be accounted for by passive sensory stimulation. However, for some visual cells, the response to a stimulus is enhanced when it is to be the target for a saccadic eye movement. This enhancement is selective for eye movements into the visual receptive field since it does not occur with eye movements to other parts of the visual field. Cells that discharge in association with a visual fixation task have foveal receptive fields and respond to the spots of light used as fixation targets. Cells discharging selectively in association with different directions of tracking eye movements have directionally selective responses to moving visual stimuli. Every cell in our sample discharging in association with movement could be driven by passive sensory stimuli. We conclude that the activity of neurons in posterior parietal cortex is dependent on and indicative of external stimuli but not predictive of movement.     

Mechanisms of neural integration in the parietal lobe for visual attention.

The impulse discharges of neurons in the inferior parietal association cortex (area 7) were studied in the alert, behaving rhesus monkey, trained to fixate and follow visual targets. Four classes of cells related to visual or visuomotor function were found. Cells of one of these are sensitive to visual stimuli and have large, contralateral receptive fields with maximal sensitivity in the far temporal quadrants. Cells of the other three classes are related to visuomotor functions: visual fixation, tracking, and saccades. They are neither sensory nor motor in the usual sense for they are activated only by interested fixation of gaze or tracking, or before visually evoked saccadic eye movements. They are not activated during the spontaneous saccades and fixations that the monkey makes while casually exploring his environment. It is hypothesized that the light-sensitive neurons provide the visual input to the visuomotor cells that, in turn, produce a command signal for the direction of visual attention and for shifting the focus of attention from one target to another.     

Spatial orientation and the representation of space with parietal lobe lesions.

Damage to the human parietal cortex leads to disturbances of spatial perception and of motor behaviour. Within the parietal lobe, lesions of the superior and of the inferior lobule induce quite different, characteristic deficits. Patients with inferior (predominantly right) parietal lobe lesions fail to explore the contralesional part of space by eye or limb movements (spatial neglect). In contrast, superior parietal lobe lesions lead to specific impairments of goal-directed movements (optic ataxia). The observations reported in this paper support the view of dissociated functions represented in the inferior and the superior lobule of the human parietal cortex. They suggest that a spatial reference frame for exploratory behaviour is disturbed in patients with neglect. Data from these patients'' visual search argue that their failure to explore the contralesional side is due to a disturbed input transformation leading to a deviation of egocentric space representation to the ipsilesional side. Data further show that this deviation follows a rotation around the earth-vertical body axis to the ipsilesional side rather than a translation towards that side. The results are in clear contrast to explanations that assume a lateral gradient ranging from a minimum of exploration in the extreme contralesional to a maximum in the extreme ipsilesional hemispace. Moreover, the failure to orient towards and to explore the contralesional part of space appears to be distinct from those deficits observed once an object of interest has been located and releases reaching. Although patients with neglect exhibit a severe bias of exploratory movements, their hand trajectories to targets in peripersonal space may follow a straight path. This result suggests that (i) exploratory and (ii) goal-directed behaviour in space do not share the same neural control mechanisms. Neural representation of space in the inferior parietal lobule seems to serve as a matrix for spatial exploration and for orienting in space but not for visuomotor processes involved in reaching for objects. Disturbances of such processes rather appear to be prominent in patients with more superior parietal lobe lesions and optic ataxia.     

Cortical visual areas in monkeys: location, topography, connections, columns, plasticity and cortical dynamics

The visual system is constantly challenged to organize the retinal pattern of stimulation into coherent percepts. This task is achieved by the cortical visual system, which is composed by topographically organized analytic areas and by synthetic areas of the temporal lobe that have more holistic processing. Additional visual areas of the parietal lobe are related to motion perception and visuomotor control. V1 and V2 represent the entire visual field. MT represents only the binocular field, and V4 only the central 30 degrees-40 degrees. The parietal areas represent more of the periphery. For any eccentricity, the receptive field grows at each step of processing, more at anterior areas in the temporal lobe. Minimal point image size increases towards the temporal lobe, but remains fairly constant toward the parietal lobe. Patterns of projection show asymmetries. Central V2 and V4 project mainly to the temporal lobe, while peripherals V2 (more than 30 degrees) and V4 (more than 10 degrees) also project to the parietal lobe. Visual information that arrives at V1 projects to V2, MT and PO, which then project to other areas. Local lateral propagation and recursive loops corroborate to perceptual completion and filling in. Priority connections to temporal, parietal and parieto-temporal cortices help construct crude early representations of objects, trajectories and movements.     

From thought to action: the parietal cortex as a bridge between perception, action, and cognition

The lateral intraparietal area (LIP) is a subdivision of the inferior parietal lobe that has been implicated in the guidance of spatial attention. In a variety of tasks, LIP provides a "salience representation" of the external world-a topographic visual representation that encodes the locations of salient or behaviorally relevant objects. Recent neurophysiological experiments show that this salience representation incorporates information about multiple behavioral variables-such as a specific motor response, reward, or category membership-associated with the task-relevant object. This integration occurs in a wide variety of tasks, including those requiring eye or limb movements or goal-directed or nontargeting operant responses. Thus, LIP acts as a multifaceted behavioral integrator that binds visuospatial, motor, and cognitive information into a topographically organized signal of behavioral salience. By specifying attentional priority as a synthesis of multiple task demands, LIP operates at the interface of perception, action, and cognition.     

Tuning Properties of MT and MSTd and Divisive Interactions for Eye-Movement Compensation

The primate brain intelligently processes visual information from the world as the eyes move constantly. The brain must take into account visual motion induced by eye movements, so that visual information about the outside world can be recovered. Certain neurons in the dorsal part of monkey medial superior temporal area (MSTd) play an important role in integrating information about eye movements and visual motion. When a monkey tracks a moving target with its eyes, these neurons respond to visual motion as well as to smooth pursuit eye movements. Furthermore, the responses of some MSTd neurons to the motion of objects in the world are very similar during pursuit and during fixation, even though the visual information on the retina is altered by the pursuit eye movement. We call these neurons compensatory pursuit neurons. In this study we develop a computational model of MSTd compensatory pursuit neurons based on physiological data from single unit studies. Our model MSTd neurons can simulate the velocity tuning of monkey MSTd neurons. The model MSTd neurons also show the pursuit compensation property. We find that pursuit compensation can be achieved by divisive interaction between signals coding eye movements and signals coding visual motion. The model generates two implications that can be tested in future experiments: (1) compensatory pursuit neurons in MSTd should have the same direction preference for pursuit and retinal visual motion; (2) there should be non-compensatory pursuit neurons that show opposite preferred directions of pursuit and retinal visual motion.     

Multimodal integration for the representation of space in the posterior parietal cortex.

The posterior parietal cortex has long been considered an ''association'' area that combines information from different sensory modalities to form a cognitive representation of space. However, until recently little has been known about the neural mechanisms responsible for this important cognitive process. Recent experiments from the author''s laboratory indicate that visual, somatosensory, auditory and vestibular signals are combined in areas LIP and 7a of the posterior parietal cortex. The integration of these signals can represent the locations of stimuli with respect to the observer and within the environment. Area MSTd combines visual motion signals, similar to those generated during an observer''s movement through the environment, with eye-movement and vestibular signals. This integration appears to play a role in specifying the path on which the observer is moving. All three cortical areas combine different modalities into common spatial frames by using a gain-field mechanism. The spatial representations in areas LIP and 7a appear to be important for specifying the locations of targets for actions such as eye movements or reaching; the spatial representation within area MSTd appears to be important for navigation and the perceptual stability of motion signals.     

Evidence for the lateral intraparietal area as the parietal eye field.

It has long been appreciated that the posterior parietal cortex plays a role in the processing of saccadic eye movements. Only recently has it been discovered that a small cortical area, the lateral intraparietal area, within this much larger area appears to be specialized for saccadic eye movements. Unlike other cortical areas in the posterior parietal cortex, the lateral intraparietal area has strong anatomical connections to other saccade centers, and its cells have saccade-related responses that begin before the saccades. The lateral intraparietal area appears to be neither a strictly visual nor strictly motor structure; rather it performs visuomotor integration functions including determining the spatial location of saccade targets and forming plans to make eye movements.     

Spatial updating in human parietal cortex

Single neurons in monkey parietal cortex update visual information in conjunction with eye movements. This remapping of stimulus representations is thought to contribute to spatial constancy. We hypothesized that a similar process occurs in human parietal cortex and that we could visualize it with functional MRI. We scanned subjects during a task that involved remapping of visual signals across hemifields. We observed an initial response in the hemisphere contralateral to the visual stimulus, followed by a remapped response in the hemisphere ipsilateral to the stimulus. We ruled out the possibility that this remapped response resulted from either eye movements or visual stimuli alone. Our results demonstrate that updating of visual information occurs in human parietal cortex.     

Only coherent spiking in posterior parietal cortex coordinates looking and reaching

Here, we report that temporally patterned, coherent spiking activity in the posterior parietal cortex (PPC) coordinates the timing of looking and reaching. Using a spike-field approach, we identify a population of parietal area LIP neurons that fire spikes coherently with 15 Hz beta-frequency LFP activity. The firing rate of coherently active neurons predicts the reaction times (RTs) of coordinated reach-saccade movements but not of saccades when made alone. Area LIP neurons that do not fire coherently do not predict RT of either movement type. Similar beta-band LFP activity is present in the parietal reach region but not nearby visual area V3d. This suggests that coherent spiking activity in PPC can control reaches and saccades together. We propose that the neural mechanism of coordination involves a shared representation that acts to slow or speed movements together.     

Control of visuotemporal attention by inferior parietal and superior temporal cortex

The human cortical visual system is organized into major pathways: a dorsal stream projecting to the superior parietal lobe (SPL), considered to be critical for visuospatial perception or on-line control of visually guided movements, and a ventral stream leading to the inferotemporal cortex, mediating object perception. Between these structures lies a large region, consisting of the inferior parietal lobe (IPL) and superior temporal gyrus (STG), the function of which is controversial. Lesions here can lead to spatial neglect, a condition associated with abnormal visuospatial perception as well as impaired visually guided movements, suggesting that the IPL+STG may have largely a "dorsal" role. Here, we use a nonspatial task to examine the deployment of visuotemporal attention in focal lesion patients, with or without spatial neglect. We show that, regardless of the presence of neglect, damage to the IPL+STG leads to a more prolonged deployment of visuotemporal attention compared to lesions of the SPL. Our findings suggest that the human IPL+STG makes an important contribution to nonspatial perception, and this is consistent with a role that is neither strictly "dorsal" nor "ventral". We propose instead that the IPL+STG has a top-down control role, contributing to the functions of both dorsal and ventral visual systems.     

From visual affordances in monkey parietal cortex to hippocampo-parietal interactions underlying rat navigation.

This paper explores the hypothesis that various subregions (but by no means all) of the posterior parietal cortex are specialized to process visual information to extract a variety of affordances for behaviour. Two biologically based models of regions of the posterior parietal cortex of the monkey are introduced. The model of the lateral intraparietal area (LIP) emphasizes its roles in dynamic remapping of the representation of targets during a double saccade task, and in combining stored, updated input with current visual input. The model of the anterior intraparietal area (AIP) addresses parietal-premotor interactions involved in grasping, and analyses the interaction between the AIP and premotor area F5. The model represents the role of other intraparietal areas working in concert with the inferotemporal cortex as well as with corollary discharge from F5 to provide and augment the affordance information in the AIP, and suggests how various constraints may resolve the action opportunities provided by multiple affordances. Finally, a systems-level model of hippocampo parietal interactions underlying rat navigation is developed, motivated by the monkey data used in developing the above two models as well as by data on neurones in the posterior parietal cortex of the monkey that are sensitive to visual motion. The formal similarity between dynamic remapping (primate saccades) and path integration (rat navigation) is noted, and certain available data on rat posterior parietal cortex in terms of affordances for locomotion are explained. The utility of further modelling, linking the World Graph model of cognitive maps for motivated behaviour with hippocampal-parietal interactions involved in navigation, is also suggested. These models demonstrate that posterior parietal cortex is not only itself a network of interacting subsystems, but functions through cooperative computation with many other brain regions.     

Recording site dependence of the neuronal spiking statistics

Spiking characteristics of neurons in the middle temporal (MT) area and the medial superior temporal (MST) area in the visual cortex of a monkey are compared with the ones in the principal sulcus (PS) area in the prefrontal cortex. The comparison is based on the basis of three inter-spike interval statistical measures: the coefficient of variation (CV), the skewness coefficient (SK) and the correlation coefficient of consecutive intervals (COR). Even for the spike sequences recorded from the same neuron, three coefficients computed from 100 intervals do not always exhibit similar values, but distribute rather widely. The distribution of three coefficients obtained from a single neuron in the MST area does not largely deviate from the distribution obtained from multiple neurons in MT and MST areas. Those distributions, however, largely deviate from the distribution obtained from neurons in the PS area. In this way, the distribution of those statistical coefficients reflects the nature of the recording site.     

Posterior parietal cortex neurons encode target motion in world-centered coordinates

The motion areas of posterior parietal cortex extract information on visual motion for perception as well as for the guidance of movement. It is usually assumed that neurons in posterior parietal cortex represent visual motion relative to the retina. Current models describing action guided by moving objects work successfully based on this assumption. However, here we show that the pursuit-related responses of a distinct group of neurons in area MST of monkeys are at odds with this view. Rather than signaling object image motion on the retina, they represent object motion in world-centered coordinates. This representation may simplify the coordination of object-directed action and ego motion-invariant visual perception.     

Sensitive period for a multimodal response in human visual motion area MT/MST

The middle temporal complex (MT/MST) is a brain region specialized for the perception of motion in the visual modality. However, this specialization is modified by visual experience: after long-standing blindness, MT/MST responds to sound. Recent evidence also suggests that the auditory response of MT/MST is selective for motion. The developmental time course of this plasticity is not known. To test for a sensitive period in MT/MST development, we used fMRI to compare MT/MST function in congenitally blind, late-blind, and sighted adults. MT/MST responded to sound in congenitally blind adults, but not in late-blind or sighted adults, and not in an individual who lost his vision between ages of 2 and 3 years. All blind adults had reduced functional connectivity between MT/MST and other visual regions. Functional connectivity was increased between MT/MST and lateral prefrontal areas in congenitally blind relative to sighted and late-blind adults. These data suggest that early blindness affects the function of feedback projections from prefrontal cortex to MT/MST. We conclude that there is a sensitive period for visual specialization in MT/MST. During typical development, early visual experience either maintains or creates a vision-dominated response. Once established, this response profile is not altered by long-standing blindness.     

Face-infringement space: the frame of reference of the ventral intraparietal area

Experimental studies have shown that responses of ventral intraparietal area (VIP) neurons specialize in head movements and the environment near the head. VIP neurons respond to visual, auditory, and tactile stimuli, smooth pursuit eye movements, and passive and active movements of the head. This study demonstrates mathematical structure on a higher organizational level created within VIP by the integration of a complete set of variables covering face-infringement. Rather than positing dynamics in an a priori defined coordinate system such as those of physical space, we assemble neuronal receptive fields to find out what space of variables VIP neurons together cover. Section 1 presents a view of neurons as multidimensional mathematical objects. Each VIP neuron occupies or is responsive to a region in a sensorimotor phase space, thus unifying variables relevant to the disparate sensory modalities and movements. Convergence on one neuron joins variables functionally, as space and time are joined in relativistic physics to form a unified spacetime. The space of position and motion together forms a neuronal phase space, bridging neurophysiology and the physics of face-infringement. After a brief review of the experimental literature, the neuronal phase space natural to VIP is sequentially characterized, based on experimental data. Responses of neurons indicate variables that may serve as axes of neural reference frames, and neuronal responses have been so used in this study. The space of sensory and movement variables covered by VIP receptive fields joins visual and auditory space to body-bound sensory modalities: somatosensation and the inertial senses. This joining of allocentric and egocentric modalities is in keeping with the known relationship of the parietal lobe to the sense of self in space and to hemineglect, in both humans and monkeys. Following this inductive step, variables are formalized in terms of the mathematics of graph theory to deduce which combinations are complete as a multidimensional neural structure that provides the organism with a complete set of options regarding objects impacting the face, such as acceptance, pursuit, and avoidance. We consider four basic variable types: position and motion of the face and of an external object. Formalizing the four types of variables allows us to generalize to any sensory system and to determine the necessary and sufficient conditions for a neural center (for example, a cortical region) to provide a face-infringement space. We demonstrate that VIP includes at least one such face-infringement space.     

Directional anisotropies reveal a functional segregation of visual motion processing for perception and action

Human exhibits an anisotropy in direction perception: discrimination is superior when motion is around horizontal or vertical rather than diagonal axes. In contrast to the consistent directional anisotropy in perception, we found only small idiosyncratic anisotropies in smooth pursuit eye movements, a motor action requiring accurate discrimination of visual motion direction. Both pursuit and perceptual direction discrimination rely on signals from the middle temporal visual area (MT), yet analysis of multiple measures of MT neuronal responses in the macaque failed to provide evidence of a directional anisotropy. We conclude that MT represents different motion directions uniformly, and subsequent processing creates a directional anisotropy in pathways unique to perception. Our data support the hypothesis that, at least for visual motion, perception and action are guided by inputs from separate sensory streams. The directional anisotropy of perception appears to originate after the two streams have segregated and downstream from area MT.     

Cortical mechanisms for trans-saccadic memory and integration of multiple object features

Constructing an internal representation of the world from successive visual fixations, i.e. separated by saccadic eye movements, is known as trans-saccadic perception. Research on trans-saccadic perception (TSP) has been traditionally aimed at resolving the problems of memory capacity and visual integration across saccades. In this paper, we review this literature on TSP with a focus on research showing that egocentric measures of the saccadic eye movement can be used to integrate simple object features across saccades, and that the memory capacity for items retained across saccades, like visual working memory, is restricted to about three to four items. We also review recent transcranial magnetic stimulation experiments which suggest that the right parietal eye field and frontal eye fields play a key functional role in spatial updating of objects in TSP. We conclude by speculating on possible cortical mechanisms for governing egocentric spatial updating of multiple objects in TSP.     

The Importance of Lateral Connections in the Parietal Cortex for Generating Motor Plans

Substantial evidence has highlighted the significant role of associative brain areas, such as the posterior parietal cortex (PPC) in transforming multimodal sensory information into motor plans. However, little is known about how different sensory information, which can have different delays or be absent, combines to produce a motor plan, such as executing a reaching movement. To address these issues, we constructed four biologically plausible network architectures to simulate PPC: 1) feedforward from sensory input to the PPC to a motor output area, 2) feedforward with the addition of an efference copy from the motor area, 3) feedforward with the addition of lateral or recurrent connectivity across PPC neurons, and 4) feedforward plus efference copy, and lateral connections. Using an evolutionary strategy, the connectivity of these network architectures was evolved to execute visually guided movements, where the target stimulus provided visual input for the entirety of each trial. The models were then tested on a memory guided motor task, where the visual target disappeared after a short duration. Sensory input to the neural networks had sensory delays consistent with results from monkey studies. We found that lateral connections within the PPC resulted in smoother movements and were necessary for accurate movements in the absence of visual input. The addition of lateral connections resulted in velocity profiles consistent with those observed in human and non-human primate visually guided studies of reaching, and allowed for smooth, rapid, and accurate movements under all conditions. In contrast, Feedforward or Feedback architectures were insufficient to overcome these challenges. Our results suggest that intrinsic lateral connections are critical for executing accurate, smooth motor plans.     

Saccadic adaptation to moving targets

Saccades are so called ballistic movements which are executed without online visual feedback. After each saccade the saccadic motor plan is modified in response to post-saccadic feedback with the mechanism of saccadic adaptation. The post-saccadic feedback is provided by the retinal position of the target after the saccade. If the target moves after the saccade, gaze may follow the moving target. In that case, the eyes are controlled by the pursuit system, a system that controls smooth eye movements. Although these two systems have in the past been considered as mostly independent, recent lines of research point towards many interactions between them. We were interested in the question if saccade amplitude adaptation is induced when the target moves smoothly after the saccade. Prior studies of saccadic adaptation have considered intra-saccadic target steps as learning signals. In the present study, the intra-saccadic target step of the McLaughlin paradigm of saccadic adaptation was replaced by target movement, and a post-saccadic pursuit of the target. We found that saccadic adaptation occurred in this situation, a further indication of an interaction of the saccadic system and the pursuit system with the aim of optimized eye movements.