A Model of Binocular Rivalry and Cross-orientation Suppression

Binocular rivalry and cross-orientation suppression are well-studied forms of competition in visual cortex, but models of these two types of competition are in tension with one another. Binocular rivalry occurs during the presentation of dichoptic grating stimuli, where two orthogonal gratings presented separately to the two eyes evoke strong alternations in perceptual dominance. Cross-orientation suppression occurs during the presentation of plaid stimuli, where the responses to a component grating presented to both eyes is weakened by the presence of a superimposed orthogonal grating. Conventional models of rivalry that rely on strong competition between orientation-selective neurons incorrectly predict rivalry between the components of plaids. Lowering the inhibitory weights in such models reduces rivalry for plaids, but also reduces it for dichoptic gratings. Using an exhaustive grid search, we show that this problem cannot be solved simply by adjusting the parameters of the model. Instead, we propose a robust class of models that rely on ocular opponency neurons, previously proposed as a mechanism for efficient stereo coding, to yield rivalry only for dichoptic gratings, not for plaids. This class of models reconciles models of binocular rivalry with the divisive normalization framework that has been used to explain cross-orientation. Our model makes novel predictions that we confirmed with psychophysical tests.     

Neural mechanisms of tactile motion integration in somatosensory cortex

How are local motion signals integrated to form a global motion percept? We investigate the neural mechanisms of tactile motion integration by presenting tactile gratings and plaids to the fingertips of monkeys, using the tactile analogue of a visual monitor and recording the responses evoked in somatosensory cortical neurons. The perceived directions of the gratings and plaids are measured in parallel psychophysical experiments. We identify a population of somatosensory neurons that exhibit integration properties comparable to those induced by analogous visual stimuli in area MT and find that these neural responses account for the perceived direction of the stimuli across all stimulus conditions tested. The preferred direction of the neurons and the perceived direction of the stimuli can be predicted from the weighted average of the directions of the individual stimulus features, highlighting that the somatosensory system implements a vector average mechanism to compute tactile motion direction that bears striking similarities to its visual counterpart.     

猫前内侧上雪氏区视神经元对运动随机线条的反应

对于运动信息在脑内的加工,一种观点认为分两阶段进行,低级视皮层只对运动图形内部成分的取向进行调谐,高级视皮层整合低级视皮层的输入,对图形整体的运动方向敏感。用网格（plaid）作为刺激的实验表明,在较低级皮层区,细胞多表现为成分方向选择性（Component-motion Selectivity),即对刺激中的取向因素敏感：而较高视皮层的细胞多表现为整体方向选择性（Pattern-motion Selecitivity),对运动整体的方向敏感,从而支持运动信息加工的“两阶段”理论。实验中,用一系列运动随机线条刺激（random line patterns)。研究猫前内侧上雪氏区（Anteriormedial lateral suprasylvian area,AMLS)神经元的方向调谐特性。结果表明多数细胞为整体方向选择性,且随线长增加此类细胞比例下降,而成分方向选择性细胞的比例有所增加,呈现由整体方向选择性向中间类型（Unclassified),由中间类型向成分方向选择性变化的趋势,提示整体或成分方向选择性可能并非细胞的固有特性,而是可以随刺激取向因素的变化而改变的。     

Responses of optokinetic neurons in the pretectum and accessory optic system of the pigeon to large-field plaids

The accessory optic system and pretectum are highly conserved brainstem visual pathways that process the visual consequences of self-motion (i.e. optic flow) and generate the optokinetic response. Neurons in these nuclei have very large receptive fields in the contalateral eye, and exhibit direction-selectivity to large-field moving stimuli. Previous research on visual motion pathways in the geniculostriate system has employed "plaids" composed of two non-parallel sine-wave gratings to investigate the visual system's ability to detect the global direction of pattern motion as opposed to the direction of motion of the components within the plaids. In this study, using standard extracellular techniques, we recorded the responses of 47 neurons in the nucleus of the basal optic root of the accessory optic system and 49 cells in the pretectal nucleus lentiformis mesencephali of pigeons to large-field gratings and plaids. We found that most neurons were classified as pattern-selective (41-49%) whereas fewer were classified as component-selective (8-17%). There were no striking differences between nucleus of the basal optic root and lentiformis mesencephali neurons in this regard. These data indicate that most of the input to the optokinetic system is orientation-insensitive but a small proportion is orientation-selective. The implications for the connectivity of the motion processing system are discussed.     

Dichoptic plaids may rival, but their motions can integrate

When the eyes view incompatible images, binocular rivalry usually results: image constituents in corresponding parts of the monocular visual fields are not perceived simultaneously. We asked naive undergraduates to view dichoptic, dioptic, and monoptic plaids. The dichoptic images evoked strong binocular rivalry when contrast was high, especially if the component gratings were set in motion. Nevertheless, the subjects' visual systems integrated the motion information across the two eyes, producing a unitary motion percept that did not reflect the image in either eye alone. By manipulating the relative spatial scale of the gratings, we affected how well the motion cohered: the results were remarkably similar between dichoptic and traditional dioptic plaids. By manipulating the relative speed of the gratings, we systematically affected the perceived direction of motion of the plaids; these results were also remarkably similar for dichoptic and dioptic plaids. Thus, the motion analysis of dichoptic and dioptic plaids is proceeding according to very similar rules, even though the dichoptic images are incompatible and evoke binocular rivalry.     

Interpreting local visual features as a global shape requires awareness

How the brain constructs a coherent representation of the environment from noisy visual input remains poorly understood. Here, we explored whether awareness of the stimulus plays a role in the integration of local features into a representation of global shape. Participants were primed with a shape defined either by position or orientation cues, and performed a shape-discrimination task on a subsequently presented probe shape. Crucially, the probe could either be defined by the same or different cues as the prime, which allowed us to distinguish the effect of priming by local features and global shape. We found a robust priming benefit for visible primes, with response times being faster when the probe and prime were the same shape, regardless of the defining cue. However, rendering the prime invisible uncovered a dissociation: position-defined primes produced behavioural benefit only for probes of the same cue type. Surprisingly, orientation-defined primes afforded an enhancement only for probes of the opposite cue. In further experiments, we showed that the effect of priming was confined to retinotopic coordinates and that there was no priming effect by invisible orientation cues in an orientation-discrimination task. This explains the absence of priming by the same cue in our shape-discrimination task. In summary, our findings show that while in the absence of awareness orientation signals can recruit retinotopic circuits (e.g. intrinsic lateral connections), conscious processing is necessary to interpret local features as global shape.     

Human vision combines oriented filters to compute edges.

The experiments examined the perceived spatial structure of plaid patterns, composed of two or three sinusoidal gratings of the same spatial frequency, superimposed at different orientations. Perceived structure corresponded well with the pattern of zero crossings in the output of a circular spatial filter applied to the image. This lends some support to Marr & Hildreth's (Proc. R. Soc. Lond. B 207, 187 (1980)) theory of edge detection as a model for human vision, but with a very different implementation. The perceived structure of two-component plaids was distorted by prior exposure to a masking or adapting grating, in a way that was perceptually equivalent to reducing the contrast of one of the plaid components. This was confirmed by finding that the plaid distortion could be nulled by increasing the contrast of the masked or adapted component. A corresponding reduction of perceived contrast for single gratings was observed after adaptation and in some masking conditions. I propose the outlines of a model for edge finding in human vision. The plaid components are processed through cortical, orientation-selective filters that are subject to attenuation by forward masking and adaptation. The outputs of these oriented filters are then linearly summed to emulate circular filtering, and zero crossings (zcs) in the combined output are used to determine edge locations. Masking or adapting to a grating attenuates some oriented filters more than others, and although this changes only the effective contrast of the components, it results in a geometric distortion at the zc level after different filters have been combined. The orientation of zcs may not correspond at all with the orientation of Fourier components, but they are correctly predicted by this two-stage model. The oriented filters are not 'orientation detectors', but are precursors to a more subtle stage that locates and represents spatial features.     

The initial phase of auditory and visual scene analysis

Auditory streaming and visual plaids have been used extensively to study perceptual organization in each modality. Both stimuli can produce bistable alternations between grouped (one object) and split (two objects) interpretations. They also share two peculiar features: (i) at the onset of stimulus presentation, organization starts with a systematic bias towards the grouped interpretation; (ii) this first percept has 'inertia'; it lasts longer than the subsequent ones. As a result, the probability of forming different objects builds up over time, a landmark of both behavioural and neurophysiological data on auditory streaming. Here we show that first percept bias and inertia are independent. In plaid perception, inertia is due to a depth ordering ambiguity in the transparent (split) interpretation that makes plaid perception tristable rather than bistable: experimental manipulations removing the depth ambiguity suppressed inertia. However, the first percept bias persisted. We attempted a similar manipulation for auditory streaming by introducing level differences between streams, to bias which stream would appear in the perceptual foreground. Here both inertia and first percept bias persisted. We thus argue that the critical common feature of the onset of perceptual organization is the grouping bias, which may be related to the transition from temporally/spatially local to temporally/spatially global computation.     

Temporal integration of movement: the time-course of motion streaks revealed by masking

Temporal integration in the visual system causes fast-moving objects to leave oriented 'motion streaks' in their wake, which could be used to facilitate motion direction perception. Temporal integration is thought to occur over ≈100 ms in early cortex, although this has never been tested for motion streaks. Here we compare the ability of fast-moving ('streaky') and slow-moving fields of dots to mask briefly flashed gratings either parallel or orthogonal to the motion trajectory. Gratings were presented at various asynchronies relative to motion onset (from -200 to +700 ms) to sample the time-course of the accumulating streaks. Predictions were that masking would be strongest for the fast parallel condition, and would be weak at early asynchronies and strengthen over time as integration rendered the translating dots more streaky and grating-like. The asynchrony where the masking function reached a plateau would correspond to the temporal integration period. As expected, fast-moving dots caused greater masking of parallel gratings than orthogonal gratings, and slow motion produced only modest masking of either grating orientation. Masking strength in the fast, parallel condition increased with time and reached a plateau after 77 ms, providing an estimate of the temporal integration period for mechanisms encoding motion streaks. Interestingly, the greater masking by fast motion of parallel compared with orthogonal gratings first reached significance at 48 ms before motion onset, indicating an effect of backward masking by motion streaks.     

A Network Model of Motion Processing in Area MT of Primates

A simple and biologically plausible model is proposed to simulatethe visual motion processing taking place in the middle temporal (MT) areaof the visual cortex in the primate brain. The model is ahierarchical neural network composed of multiple competitive learninglayers. The input layer of the network simulates the neurons in the primaryvisual cortex (V1), which are sensitive to the orientation and motionvelocity of the visual stimuli, and the middle and output layers of thenetwork simulate the component MT and pattern MT neurons, which areselectively responsive to local and global motions, respectively. Thenetwork model was tested with various simulated motion patterns (random dotsof different direction correlations, transparent motion, grating and plaidpatterns, and so on). The response properties of the model closely resemblemany of the known features of the MT neurons found neurophysiologically.These results show that the sophisticated response behaviors of the MTneurons can emerge naturally from some very simple models, such as acompetitive learning network.     

Two-dimensional motion perception without feature tracking

Feature-tracking explanations of 2D motion perception are fundamentally distinct from motion-energy, correlation, and gradient explanations, all of which can be implemented by applying spatiotemporal filters to raw image data. Filter-based explanations usually suffer from the aperture problem, but 2D motion predictions for moving plaids have been derived from the intersection of constraints (IOC) imposed by the outputs of such filters, and from the vector sum of signals generated by such filters. In most previous experiments, feature-tracking and IOC predictions are indistinguishable. By constructing plaids in apparent motion from missing-fundamental gratings, we set feature-tracking predictions in opposition to both IOC and vector-sum predictions. The perceived directions that result are inconsistent with feature tracking. Furthermore, we show that increasing size and spatial frequency in Type 2 missing-fundamental plaids drives perceived direction from vector-sum toward IOC directions. This reproduces results that have been used to support feature-tracking, but under experimental conditions that rule it out. We discuss our data in the context of a Bayesian model with a gradient-based likelihood and a prior favoring slow speeds. We conclude that filter-based explanations alone can explain both veridical and non-veridical 2D motion perception in such stimuli.     

Parallel visual motion processing streams for manipulable objects and human movements

We tested the hypothesis that different regions of lateral temporal cortex are specialized for processing different types of visual motion by studying the cortical responses to moving gratings and to humans and manipulable objects (tools and utensils) that were either stationary or moving with natural or artificially generated motions. Segregated responses to human and tool stimuli were observed in both ventral and lateral regions of posterior temporal cortex. Relative to ventral cortex, lateral temporal cortex showed a larger response for moving compared with static humans and tools. Superior temporal cortex preferred human motion, and middle temporal gyrus preferred tool motion. A greater response was observed in STS to articulated compared with unarticulated human motion. Specificity for different types of complex motion (in combination with visual form) may be an organizing principle in lateral temporal cortex.     

A model for direction selectivity in threshold motion perception

Thresholds were measured for a moving line superimposed on moving sinusoidal gratings. When line and grating moved in the same direction significant subthreshold summation was observed over a range of spatial frequencies. For motion of the line and grating in opposite directions, summation was never observed. This supports the hypothesis that direction selective mechanisms are responsible for motion perception at threshold. Further analysis of the data produced estimates of the spatial frequency tuning of these mechanisms. A quantitative model is proposed to interpret the data, and it is suggested that flickering gratings are not decomposed into their moving components by the visual system.     

Shape Invariant Coding of Motion Direction in Somatosensory Cortex

Invariant representations of stimulus features are thought to play an important role in producing stable percepts of objects. In the present study, we assess the invariance of neural representations of tactile motion direction with respect to other stimulus properties. To this end, we record the responses evoked in individual neurons in somatosensory cortex of primates, including areas 3b, 1, and 2, by three types of motion stimuli, namely scanned bars and dot patterns, and random dot displays, presented to the fingertips of macaque monkeys. We identify a population of neurons in area 1 that is highly sensitive to the direction of stimulus motion and whose motion signals are invariant across stimulus types and conditions. The motion signals conveyed by individual neurons in area 1 can account for the ability of human observers to discriminate the direction of motion of these stimuli, as measured in paired psychophysical experiments. We conclude that area 1 contains a robust representation of motion and discuss similarities in the neural mechanisms of visual and tactile motion processing.     

Orientation selectivity and spatial frequency characteristics of receptive fields of occipital cortical neurons in cats

Spatial frequency characteristics of receptive fields of occipital cortical neurons were investigated in cats during presentation of visual stimuli consisting of gratings in four or eight standard orientations. The maximal increase in discharge frequency of the neurons was observed when the grating was presented in one particular orientation, which was taken to be optimal for those particular neurons. Responses of some neurons to presentation of gratings in nonoptimal orientations were less than optimal; inhibition of activity below the spontaneous discharge level was observed in other cells in this case. Maximal inhibition was observed to the orientation perpendicular to optimal. Inhibition of unit activity evoked by presentation of gratings in the nonoptimal orientation was shown to be a function of spatial frequency.I. P. Pavlov Institute of Physiology, Academy of Sciences of the USSR, Leningrad. Translated from Neirofiziologiya, Vol. 13, No. 3, pp. 227–232, May–June, 1981.     

The validity of d' measures

Subliminal perception occurs when prime stimuli that participants claim not to be aware of nevertheless influence subsequent processing of a target. This claim, however, critically depends on correct methods to assess prime awareness. Typically, d' ("d prime") tasks administered after a priming task are used to establish that people are unable to discriminate between different primes. Here, we show that such d' tasks are influenced by the nature of the target, by attentional factors, and by the delay between stimulus presentation and response. Our results suggest that the standard d' task is not a straightforward measure of prime visibility. We discuss the implications of our findings for subliminal perception research.     

Motion adaptation distorts perceived visual position

After an observer adapts to a moving stimulus, texture within a stationary stimulus is perceived to drift in the opposite direction-the traditional motion aftereffect (MAE). It has recently been shown that the perceived position of objects can be markedly influenced by motion adaptation. In the present study, we examine the selectivity of positional shifts resulting from motion adaptation to stimulus attributes such as velocity, relative contrast, and relative spatial frequency. In addition, we ask whether spatial position can be modified in the absence of perceived motion. Results show that when adapting and test stimuli have collinear carrier gratings, the global position of the object shows a substantial shift in the direction of the illusory motion. When the carrier gratings of the adapting and test stimuli are orthogonal (a configuration in which no MAE is experienced), a global positional shift of similar magnitude is found. The illusory positional shift was found to be immune to changes in spatial frequency and to contrast between adapting and test stimuli-manipulations that dramatically reduce the magnitude of the traditional MAE. The lack of sensitivity for stimulus characteristics other than direction of motion suggests that a specialized population of cortical neurones, which are insensitive to changes in a number of rudimentary visual attributes, may modulate positional representation in lower cortical areas.     

复合运动条纹刺激下的视动震颤（OKN）眼动反应

研究视动震颤眼动系统在同时包含两个二维运动的复合运动条纹刺激下的反应特性,并探讨两种子条纹运动方向的夹角和运动速度的影响。实验结果发现,在一定参数范围内,复合运动条纹引起了双重交替ＯＫＮ反应,即ＫＯＮ交替地跟踪合成运动和分别运动;在跟踪分别运动中,又是交替地跟踪两种子条纹的运动。     

对刺激朝向改变的自动加工:事件相关电位的证据

利用事件相关电位（ＥＲＰ）技术,探讨非注意状态的刺激朝向改变是否引起自动加工。刺激为具有一定朝向（垂直和水平各５０％）和一定空间频率（低频９０％,高频１０％）的光栅。要求被试忽略光栅朝向,对高频光栅作反应。刺激呈现时间为５０ｍｓ,刺激间隔在２５０至４５０ｍｓ之间随机变化。低频光栅刺激被分为两类,“匹配”（与前一刺激朝向相同）和“失匹配”（与前一刺激朝向不同）。结果发现,失匹配刺激比匹配刺激诱发出更大的枕区Ｐ１、更大的前额－中央区Ｎ１以及更大的前部与顶区Ｐ２,但前部与顶区的Ｎ２却更小。这些ＥＲＰｓ变化提示,视觉对非注意的刺激朝向变化进行了一定程度的自动加工;视觉通道可能存在类似听觉失匹配负波（ＭＭＮ）的、然而机制不同的自动加工成分     

See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex

Our understanding of multisensory integration has advanced because of recent functional neuroimaging studies of three areas in human lateral occipito-temporal cortex: superior temporal sulcus, area LO and area MT (V5). Superior temporal sulcus is activated strongly in response to meaningful auditory and visual stimuli, but responses to tactile stimuli have not been well studied. Area LO shows strong activation in response to both visual and tactile shape information, but not to auditory representations of objects. Area MT, an important region for processing visual motion, also shows weak activation in response to tactile motion, and a signal that drops below resting baseline in response to auditory motion. Within superior temporal sulcus, a patchy organization of regions is activated in response to auditory, visual and multisensory stimuli. This organization appears similar to that observed in polysensory areas in macaque superior temporal sulcus, suggesting that it is an anatomical substrate for multisensory integration. A patchy organization might also be a neural mechanism for integrating disparate representations within individual sensory modalities, such as representations of visual form and visual motion.