Two-dimensional substructure of MT receptive fields.

Neurons at progressively higher levels of the visual system have progressively larger, more complicated receptive fields, presumably constructed from simpler antecedent receptive fields. To study this hierarchical organization, we used sparse white noise to map receptive-field substructure (second order Wiener-like kernels) in an extrastriate motion processing area (MT) of alert monkeys. The maps revealed a clear substructure, on a spatial scale comparable to the receptive fields of the V1 inputs. There were both facilitatory and suppressive interactions that differed in spatial organization and time course. Directional interactions were remarkably precise over a very small spatial range, and reversed when successive stimuli reversed contrast--a neural correlate of "reverse phi" motion perception. The maps of some cells had an unexpected, curved shape, which challenges existing models for direction selectivity.     

Dissociation of neuronal and psychophysical responses to local and global motion

Most neurons in cortical area MT (V5) are strongly direction selective, and their activity is closely associated with the perception of visual motion. These neurons have large receptive fields built by combining inputs with smaller receptive fields that respond to local motion. Humans integrate motion over large areas and can perceive what has been referred to as global motion. The large size and direction selectivity of MT receptive fields suggests that MT neurons may represent global motion. We have explored this possibility by measuring responses to a stimulus in which the directions of simultaneously presented local and global motion are independently controlled. Surprisingly, MT responses depended only on the local motion and were unaffected by the global motion. Yet, under similar conditions, human observers perceive global motion and are impaired in discriminating local motion. Although local motion perception might depend on MT signals, global motion perception depends on mechanisms qualitatively different from those in MT. Motion perception therefore does not depend on a single cortical area but reflects the action and interaction of multiple brain systems.     

End-stopping and the aperture problem: two-dimensional motion signals in macaque V1

Our perception of fine visual detail relies on small receptive fields at early stages of visual processing. However, small receptive fields tend to confound the orientation and velocity of moving edges, leading to ambiguous or inaccurate motion measurements (the aperture problem). Thus, it is often assumed that neurons in primary visual cortex (V1) carry only ambiguous motion information. Here we show that a subpopulation of V1 neurons is capable of signaling motion direction in a manner that is independent of contour orientation. Specifically, end-stopped V1 neurons obtain accurate motion measurements by responding only to the endpoints of long contours, a strategy which renders them largely immune to the aperture problem. Furthermore, the time course of end-stopping is similar to the time course of motion integration by MT neurons. These results suggest that cortical neurons might represent object motion by responding selectively to two-dimensional discontinuities in the visual scene.     

Organization of receptive fields of motion-senstitive neurons in the cat pulvinar

The distribution of 70 visually sensitive neurons in the cat pulvinar sensitive to motion in the receptive fields was studied. The experimental results showed that components with directional characteristics are present in the structure of these fields of both direction-selective and unselective neurons. In the receptive fields of direction-selective neurons the directional elements of the substructure have identical preferred directions, which coincide with the preferred directions of response to stimulus movement over the entire receptive field. The organization of receptive fields of direction-selective neurons of the visual association structure thus does not differ significantly from that of analogous fields of visual projection neurons. Directional elements of the receptive fields of direction-unselective neurons were found to have different preferred directions, thereby providing a basis for organization of the nondirectional response of the neuron to a stimulus moving across the entire receptive field.L. A. Orbeli Institute of Physiology, Academy of Sciences of the Armenian SSR, Erevan. Translated from Neirofiziologiya, Vol. 14, No. 4, pp. 339–346, July–August, 1982.     

Neural Mechanisms of Cortical Motion Computation Based on a Neuromorphic Sensory System

The visual cortex analyzes motion information along hierarchically arranged visual areas that interact through bidirectional interconnections. This work suggests a bio-inspired visual model focusing on the interactions of the cortical areas in which a new mechanism of feedforward and feedback processing are introduced. The model uses a neuromorphic vision sensor (silicon retina) that simulates the spike-generation functionality of the biological retina. Our model takes into account two main model visual areas, namely V1 and MT, with different feature selectivities. The initial motion is estimated in model area V1 using spatiotemporal filters to locally detect the direction of motion. Here, we adapt the filtering scheme originally suggested by Adelson and Bergen to make it consistent with the spike representation of the DVS. The responses of area V1 are weighted and pooled by area MT cells which are selective to different velocities, i.e. direction and speed. Such feature selectivity is here derived from compositions of activities in the spatio-temporal domain and integrating over larger space-time regions (receptive fields). In order to account for the bidirectional coupling of cortical areas we match properties of the feature selectivity in both areas for feedback processing. For such linkage we integrate the responses over different speeds along a particular preferred direction. Normalization of activities is carried out over the spatial as well as the feature domains to balance the activities of individual neurons in model areas V1 and MT. Our model was tested using different stimuli that moved in different directions. The results reveal that the error margin between the estimated motion and synthetic ground truth is decreased in area MT comparing with the initial estimation of area V1. In addition, the modulated V1 cell activations shows an enhancement of the initial motion estimation that is steered by feedback signals from MT cells.     

Orientation tuning of motion-sensitive neurons shaped by vertical-horizontal network interactions

We measured the orientation tuning of two neurons of the fly lobula plate (H1 and H2 cells) sensitive to horizontal image motion. Our results show that H1 and H2 cells are sensitive to vertical motion, too. Their response depended on the position of the vertically moving stimuli within their receptive field. Stimulation within the frontal receptive field produced an asymmetric response: upward motion left the H1/H2 spike frequency nearly unaltered while downward motion increased the spike frequency to about 40% of their maximum responses to horizontal motion. In the lateral parts of their receptive fields, no such asymmetry in the responses to vertical image motion was found. Since downward motion is known to be the preferred direction of neurons of the vertical system in the lobula plate, we analyzed possible interactions between vertical system cells and H1 and H2 cells. Depolarizing current injection into the most frontal vertical system cell (VS1) led to an increased spike frequency, hyperpolarizing current injection to a decreased spike frequency in both H1 and H2 cells. Apart from VS1, no other vertical system cell (VS2-8) had any detectable influence on either H1 or H2 cells. The connectivity of VS1 and H1/H2 is also shown to influence the response properties of both centrifugal horizontal cells in the contralateral lobula plate, which are known to be postsynaptic to the H1 and H2 cells. The vCH cell receives additional input from the contralateral VS2-3 cells via the spiking interneuron V1.     

Local and global motion preferences in descending neurons of the fly

For a moving animal, optic flow is an important source of information about its ego-motion. In flies, the processing of optic flow is performed by motion sensitive tangential cells in the lobula plate. Amongst them, cells of the vertical system (VS cells) have receptive fields with similarities to optic flows generated during rotations around different body axes. Their output signals are further processed by pre-motor descending neurons. Here, we investigate the local motion preferences of two descending neurons called descending neurons of the ocellar and vertical system (DNOVS1 and DNOVS2). Using an LED arena subtending 240° × 95° of visual space, we mapped the receptive fields of DNOVS1 and DNOVS2 as well as those of their presynaptic elements, i.e. VS cells 1–10 and V2. The receptive field of DNOVS1 can be predicted in detail from the receptive fields of those VS cells that are most strongly coupled to the cell. The receptive field of DNOVS2 is a combination of V2 and VS cells receptive fields. Predicting the global motion preferences from the receptive field revealed a linear spatial integration in DNOVS1 and a superlinear spatial integration in DNOVS2. In addition, the superlinear integration of V2 output is necessary for DNOVS2 to differentiate between a roll rotation and a lift translation of the fly.     

Relationship between Size Summation Properties,Contrast Sensitivity and Response Latency in the Dorsomedial and Middle Temporal Areas of the Primate Extrastriate Cortex

Analysis of the physiological properties of single neurons in visual cortex has demonstrated that both the extent of their receptive fields and the latency of their responses depend on stimulus contrast. Here, we explore the question of whether there are also systematic relationships between these response properties across different cells in a neuronal population. Single unit recordings were obtained from the middle temporal (MT) and dorsomedial (DM) extrastriate areas of anaesthetized marmoset monkeys. For each cell, spatial integration properties (length and width summation, as well as the presence of end- and side-inhibition within 15° of the receptive field centre) were determined using gratings of optimal direction of motion and spatial and temporal frequencies, at 60% contrast. Following this, contrast sensitivity was assessed using gratings of near-optimal length and width. In both areas, we found a relationship between spatial integration and contrast sensitivity properties: cells that summated over smaller areas of the visual field, and cells that displayed response inhibition at larger stimulus sizes, tended to show higher contrast sensitivity. In a sample of MT neurons, we found that cells showing longer latency responses also tended to summate over larger expanses of visual space in comparison with neurons that had shorter latencies. In addition, longer-latency neurons also tended to show less obvious surround inhibition. Interestingly, all of these effects were stronger and more consistent with respect to the selectivity for stimulus width and strength of side-inhibition than for length selectivity and end-inhibition. The results are partially consistent with a hierarchical model whereby more extensive receptive fields require convergence of information from larger pools of “feedforward” afferent neurons to reach near-optimal responses. They also suggest that a common gain normalization mechanism within MT and DM is involved, the spatial extent of which is more evident along the cell’s preferred axis of motion.     

Reaching beyond the classical receptive field of V1 neurons: horizontal or feedback axons?

It is commonly assumed that the orientation-selective surround field of neurons in primary visual cortex (V1) is due to interactions provided solely by intrinsic long-range horizontal connections. We review evidence for and against this proposition and conclude that horizontal connections are too slow and cover too little visual field to subserve all the functions of suppressive surrounds of V1 neurons in the macaque monkey. We show that the extent of visual space covered by horizontal connections corresponds to the region of low contrast summation of the receptive field center mechanism. This region encompasses the classically defined receptive field center and the proximal surround. Beyond this region, feedback connections are the most likely substrate for surround suppression. We present evidence that inactivation of higher order areas leads to a major decrease in the strength of the suppressive surround of neurons in lower order areas, supporting the hypothesis that feedback connections play a major role in center-surround interactions.     

Predictive Feedback Can Account for Biphasic Responses in the Lateral Geniculate Nucleus

Biphasic neural response properties, where the optimal stimulus for driving a neural response changes from one stimulus pattern to the opposite stimulus pattern over short periods of time, have been described in several visual areas, including lateral geniculate nucleus (LGN), primary visual cortex (V1), and middle temporal area (MT). We describe a hierarchical model of predictive coding and simulations that capture these temporal variations in neuronal response properties. We focus on the LGN-V1 circuit and find that after training on natural images the model exhibits the brain's LGN-V1 connectivity structure, in which the structure of V1 receptive fields is linked to the spatial alignment and properties of center-surround cells in the LGN. In addition, the spatio-temporal response profile of LGN model neurons is biphasic in structure, resembling the biphasic response structure of neurons in cat LGN. Moreover, the model displays a specific pattern of influence of feedback, where LGN receptive fields that are aligned over a simple cell receptive field zone of the same polarity decrease their responses while neurons of opposite polarity increase their responses with feedback. This phase-reversed pattern of influence was recently observed in neurophysiology. These results corroborate the idea that predictive feedback is a general coding strategy in the brain.     

Global versus local adaptation in fly motion-sensitive neurons

Flies, like humans, experience a well-known consequence of adaptation to visual motion, the waterfall illusion. Direction-selective neurons in the fly lobula plate permit a detailed analysis of the mechanisms responsible for motion adaptation and their function. Most of these neurons are spatially non-opponent, they sum responses to motion in the preferred direction across their entire receptive field, and adaptation depresses responses by subtraction and by reducing contrast gain. When we adapted a small area of the receptive field to motion in its anti-preferred direction, we discovered that directional gain at unadapted regions was enhanced. This novel phenomenon shows that neuronal responses to the direction of stimulation in one area of the receptive field are dynamically adjusted to the history of stimulation both within and outside that area.     

Attention, adaptation, and the motion aftereffect

Activation of the human visual motion area V5/MT was previously thought to be the basis of the motion aftereffect. New findings suggest that previous observations were confounded by attention and arousal, providing evidence that adaptation of directionally selective neurons in area V5/MT represents the fundamental substrate for the motion aftereffect.     

‘Vector white noise’: a technique for mapping the motion receptive fields of direction-selective visual neurons

A technique is described and tested for mapping the sensitivities and preferred directions of motion at different locations within the receptive fields of direction-selective motion-detecting visual neurons. The procedure is to record the responses to a number of visual stimuli, each stimulus presentation consisting of a set of short, randomly-oriented, moving bars arranged in a square grid. Each bar moves perpendicularly to its long axis. The vector describing the sensitivity and preferred direction of motion at each grid location is obtained as a sum of the unit vectors defining the directions of motion of the bars in each of the stimuli at that location, weighted by the strengths of the corresponding responses. The resulting vector field specifies the optimum flow field for the neuron. The advantage of this technique over the conventional approach of probing the receptive field sequentially at each grid location is that the parallel nature of the stimulus is sensitive to nonlinear interactions (such as shunting inhibition for mutual facilitation) between different regions of the visual field. The technique is used to determine accurately the motion receptive fields of direction-selective motion detecting neurons in the optic lobes of insects. It is potentially applicable to motion-sensitive neurons with highly structured receptive fields, such as those in the optic tectum of the pigeon or in area MST of the monkey.     

Mathematical model for self-organization of direction columns in the primate middle temporal area

We attempted to reproduce modular structures for direction selectivity characteristic of the primate middle temporal area (MT) based on our thermodynamic model for the activity-dependent self-organization of neural networks. We assumed that excitatory afferent input to MT neurons arises from V1 and/or V2 neurons which are selective to both orientation of a visual stimulus and direction of its motion, and that such input is modifiable and becomes selectively connected through the process of self-organization. By contrast, local circuit connections within MT are unmodifiable and remain nonselectively connected (isotropic). The present simulations reproduced characteristic patterns of organization in the cortex of MT in that: (1) preferred directions of the afferent input gradually shifted, except for singularity lines where direction abruptly changed by 180°; (2) model MT neurons located between the singularity lines responded to unidirectionally moving stimuli, closely reflecting preferred direction of the afferent input; (3) neurons responding to stimuli moving in two opposite directions were located along the singularity lines; and (4) neurons responding to stimuli moving in any direction were clustered at the ends of the singularity lines. When the strength of the lateral inhibition was decreased, direction selectivity of MT neurons was reduced. Therefore, the lateral inhibition, even if isotropic, strengthens the direction selectivity of MT neurons. Expression of singularities changed depending on a parameter that represents the relative dominance of the direction selectivity to the orientation selectivity of the afferent input. When the direction selectivity was predominant, singularity points were formed, while when the orientation selectivity prevailed, the MT was covered by two-dimensional singularity networks. Line singularities similar to those experimentally observed were reproduced when these two types of selectivity were in balance. Received: 15 October 1992/Accepted in revised form: 27 June 1993     

The spatial substructure of visual receptive fields in the cat's superior colliculus

Although the direction selective properties of the superficial layer cells of the cat's superior colliculus have been extensively studied, the mechanisms underlying this property remain controversial. With the aim to understand the mechanism(s) underlying directional selectivity of collicular neurons we examined the substructure of their visual receptive fields. 1. The strength of cell responses and the direction selectivity indices varied in relation to the location of the tested region within the receptive field and the amplitude of stimulus movement. 2. Decrease of the amplitude of motion resulted in a decrease of direction selectivity index both in the group of direction-selective cells and in the group of cells classified as direction nonselective but with a directional bias. 3. The decrease of direction selectivity for small amplitude movement resulted mainly from increase in the magnitude of response in the nonpreferred direction of movement. 4. These results suggest that the receptive fields of most collicular cells are composed of subregions with different response profiles and indicate that inhibitory mechanisms dictate direction selectivity of collicular cells.     

Adaptive surround modulation in cortical area MT

Visual motion perception relies on two opposing operations: integration and segmentation. Integration overcomes motion ambiguity in the visual image by spatial pooling of motion signals, whereas segmentation identifies differences between adjacent moving objects. For visual motion area MT, previous investigations have reported that stimuli in the receptive field surround, which do not elicit a response when presented alone, can nevertheless modulate responses to stimuli in the receptive field center. The directional tuning of this "surround modulation" has been found to be mainly antagonistic and hence consistent with segmentation. Here, we report that surround modulation in area MT can be either antagonistic or integrative depending upon the visual stimulus. Both types of modulation were delayed relative to response onset. Our results suggest that the dominance of antagonistic modulation in previous MT studies was due to stimulus choice and that segmentation and integration are achieved, in part, via adaptive surround modulation.     

Cortical visual areas in monkeys: location, topography, connections, columns, plasticity and cortical dynamics

The visual system is constantly challenged to organize the retinal pattern of stimulation into coherent percepts. This task is achieved by the cortical visual system, which is composed by topographically organized analytic areas and by synthetic areas of the temporal lobe that have more holistic processing. Additional visual areas of the parietal lobe are related to motion perception and visuomotor control. V1 and V2 represent the entire visual field. MT represents only the binocular field, and V4 only the central 30 degrees-40 degrees. The parietal areas represent more of the periphery. For any eccentricity, the receptive field grows at each step of processing, more at anterior areas in the temporal lobe. Minimal point image size increases towards the temporal lobe, but remains fairly constant toward the parietal lobe. Patterns of projection show asymmetries. Central V2 and V4 project mainly to the temporal lobe, while peripherals V2 (more than 30 degrees) and V4 (more than 10 degrees) also project to the parietal lobe. Visual information that arrives at V1 projects to V2, MT and PO, which then project to other areas. Local lateral propagation and recursive loops corroborate to perceptual completion and filling in. Priority connections to temporal, parietal and parieto-temporal cortices help construct crude early representations of objects, trajectories and movements.     

Segregation of object and background motion in visual area MT: effects of microstimulation on eye movements

To track a moving object, its motion must first be distinguished from that of the background. The center-surround properties of neurons in the middle temporal visual area (MT) may be important for signaling the relative motion between object and background. To test this, we microstimulated within MT and measured the effects on monkeys' eye movements to moving targets. We found that stimulation at "local motion" sites, where receptive fields possessed antagonistic surrounds, shifted pursuit in the preferred direction of the neurons, whereas stimulation at "wide-field motion" sites shifted pursuit in the opposite, or null, direction. We propose that activating wide-field sites simulated background motion, thus inducing a target motion signal in the opposite direction. Our results support the hypothesis that neuronal center-surround mechanisms contribute to the behavioral segregation of objects from the background.     

Rabbit visual cortical neurons with simple and complex receptive fields

Receptive fields of neurons of the rabbit visual cortex selective for stimulus orientation were investigated. These receptive fields were less well differentiated than those of the analogous neurons of the cat visual cortex (large in size and circular in shape). Two mechanisms of selectivity for stimulus orientation were observed: inhibition between on and off zones of the receptive field (sample type) and oriented lateral inhibition within the same zone of the receptive field (complex type). Lateral inhibition within the same zone of the receptive field also took place in unselective neurons; "complex" selective neurons differed from them in the orientation of this inhibition. A combination of both mechanisms was possible in the receptive field of the same neuron. It is suggested that both simple and complex receptive fields are derivatives of unselective receptive fields and that "complex" neurons are not the basis for a higher level of analysis of visual information than in "simple" neurons.A. N. Severtsov Institute of Evolutionary Morphology and Ecology of Animals, Academy of Sciences of the USSR, Moscow. Translated from Neirofiziologiya, Vol. 10, No. 1, pp. 13–21, January–February, 1978.