Motion Noise Changes Directional Interaction between Transparently Moving Stimuli from Repulsion to Attraction

To interpret visual scenes, visual systems need to segment or integrate multiple moving features into distinct objects or surfaces. Previous studies have found that the perceived direction separation between two transparently moving random-dot stimuli is wider than the actual direction separation. This perceptual “direction repulsion” is useful for segmenting overlapping motion vectors. Here we investigate the effects of motion noise on the directional interaction between overlapping moving stimuli. Human subjects viewed two overlapping random-dot patches moving in different directions and judged the direction separation between the two motion vectors. We found that the perceived direction separation progressively changed from wide to narrow as the level of motion noise in the stimuli was increased, showing a switch from direction repulsion to attraction (i.e. smaller than the veridical direction separation). We also found that direction attraction occurred at a wider range of direction separations than direction repulsion. The normalized effects of both direction repulsion and attraction were the strongest near the direction separation of ∼25° and declined as the direction separation further increased. These results support the idea that motion noise prompts motion integration to overcome stimulus ambiguity. Our findings provide new constraints on neural models of motion transparency and segmentation.     

Effects of adaptation to apparent movement on recovery of structure from motion.

Past work on the recovery of three-dimensional structure from dynamic two-dimensional images has led to inconsistent conclusions regarding the contributions of the short-range and long-range motion processes. In the present experiments, subjects adapted to displays (either four lines or 50 randomly positioned pixels) whose spatiotemporal parameters were chosen to favor either the short-range or long-range process. Adaptation periods were followed by test displays that simulated the rotation of a four-pixel random object about the vertical gamma-axis. The dependent measure was the angle of rotation between successive frames of the rotation display at which percepts of three-dimensional structure broke down. Both the original data and derived measures based on best-fitting polynomials showed small but consistent effects: Compared to control conditions, adaptation to short-range motion reduced the angle at which percepts of structure broke down; adaptation to long-range motion increased them. It is suggested that both low-level (i.e. short-range) and high-level (long-range) processes contribute to the recovery of structure from motion.     

On the contours of apparent motion: A new perspective on visual space-time

Previous results on the perception of motion indicate that perceived motion paths cannot be explained solely in terms of simple feature-specific analyzers. This is particularly true of apparent (phi) motion. In this paper we develop a dynamic network, with simple filtering and summation properties, which can predict the geometric paths of apparent motion in various spatio-temporal configurations. The network assumptions predict a non-Euclidean metric for the visual space-time of motion perception and we consider the implications of such distortions for various visual displays, including illusions.     

Submitochondrial localization and asymmetric disposition of two peripheral cyclic nucleotide phosphodiesterases.

There are two distinct cyclic AMP phosphodiesterases associated with the liver mitochondrion: one with the outer membrane and one with the inner membrane. No activity is associated with the lysosomal fraction. Both of the enzymes are peripheral proteins and can be released from the membranes by high-ionic-strength treatment. Treatment of intact mitochondria with trypsin and insoluble trypsin localizes these enzymes to the cytosol-facing surface of their respective membranes. The enzymes differ in regard to sedimentation coefficient, thermostability and susceptibility to inactivation by trypsin. Both enzymes degrade cyclic AMP and cyclic GMP. Whereas the outer-membrane enzyme displays Michaelis kinetics and appears to be a low-affinity enzyme, the inner-membrane enzyme displays kinetics indicative of apparent negative co-operativity.     

A Common Cortical Circuit Mechanism for Perceptual Categorical Discrimination and Veridical Judgment

Perception involves two types of decisions about the sensory world: identification of stimulus features as analog quantities, or discrimination of the same stimulus features among a set of discrete alternatives. Veridical judgment and categorical discrimination have traditionally been conceptualized as two distinct computational problems. Here, we found that these two types of decision making can be subserved by a shared cortical circuit mechanism. We used a continuous recurrent network model to simulate two monkey experiments in which subjects were required to make either a two-alternative forced choice or a veridical judgment about the direction of random-dot motion. The model network is endowed with a continuum of bell-shaped population activity patterns, each representing a possible motion direction. Slow recurrent excitation underlies accumulation of sensory evidence, and its interplay with strong recurrent inhibition leads to decision behaviors. The model reproduced the monkey's performance as well as single-neuron activity in the categorical discrimination task. Furthermore, we examined how direction identification is determined by a combination of sensory stimulation and microstimulation. Using a population-vector measure, we found that direction judgments instantiate winner-take-all (with the population vector coinciding with either the coherent motion direction or the electrically elicited motion direction) when two stimuli are far apart, or vector averaging (with the population vector falling between the two directions) when two stimuli are close to each other. Interestingly, for a broad range of intermediate angular distances between the two stimuli, the network displays a mixed strategy in the sense that direction estimates are stochastically produced by winner-take-all on some trials and by vector averaging on the other trials, a model prediction that is experimentally testable. This work thus lends support to a common neurodynamic framework for both veridical judgment and categorical discrimination in perceptual decision making.     

Visual Benefits in Apparent Motion Displays: Automatically Driven Spatial and Temporal Anticipation Are Partially Dissociated

Many behaviourally relevant sensory events such as motion stimuli and speech have an intrinsic spatio-temporal structure. This will engage intentional and most likely unintentional (automatic) prediction mechanisms enhancing the perception of upcoming stimuli in the event stream. Here we sought to probe the anticipatory processes that are automatically driven by rhythmic input streams in terms of their spatial and temporal components. To this end, we employed an apparent visual motion paradigm testing the effects of pre-target motion on lateralized visual target discrimination. The motion stimuli either moved towards or away from peripheral target positions (valid vs. invalid spatial motion cueing) at a rhythmic or arrhythmic pace (valid vs. invalid temporal motion cueing). Crucially, we emphasized automatic motion-induced anticipatory processes by rendering the motion stimuli non-predictive of upcoming target position (by design) and task-irrelevant (by instruction), and by creating instead endogenous (orthogonal) expectations using symbolic cueing. Our data revealed that the apparent motion cues automatically engaged both spatial and temporal anticipatory processes, but that these processes were dissociated. We further found evidence for lateralisation of anticipatory temporal but not spatial processes. This indicates that distinct mechanisms may drive automatic spatial and temporal extrapolation of upcoming events from rhythmic event streams. This contrasts with previous findings that instead suggest an interaction between spatial and temporal attention processes when endogenously driven. Our results further highlight the need for isolating intentional from unintentional processes for better understanding the various anticipatory mechanisms engaged in processing behaviourally relevant stimuli with predictable spatio-temporal structure such as motion and speech.     

The perception of apparent movement

When two similar pictures, overlapping but slightly displaced, were projected on a screen in alternation, apparent movement could be seen. How similar must successive pictures be to give apparent movement? This is the 'correspondence problem'. Manipulations of the local and global correspondences between pictures included motion phenomena such as reversed apparent movement; a four-stroke oscillatory cycle which gave an illusion of continuous motion in one direction; edges defined by texture, stereoscopic depth, or flicker, kinetic edges; and wave motion. It was concluded that human motion perception may comprise two separate mechanisms. Local point-by-point correlations between pictures are detected by a relatively peripheral system, probably based on directonally selective neural units. More subtle global correspondences are analysed by a more cognitive system which extracts edges before it process motion.     

Spatio-temporal parameters and the three-dimensionality of apparent motion: evidence for two types of processing

The minimum ISI required for perceiving apparent motion in depth was measured as a function of the 2D separation of stimuli and the physical separation of stimuli in depth. It was found that temporal thresholds increased as a function of the separation of stimuli in depth. This supports the results of previous research indicating that the perceived three-dimensionality of apparent motion in depth increases with ISI. In addition, the rate of threshold increase was significantly greater in displays with short 2D separations of stimuli than in displays with large 2D separations. This robust functional dissociation of thresholds indicates that the short-range system may be involved in the processing of apparent motion in depth in the former case.     

Motion detection in human vision: a unifying approach based on energy and features

Most studies of human motion perception have been based on the implicit assumption that the brain has only one motion-detection system, or at least that only one is operational in any given instance. We show, in the context of direction perception in spatially filtered two-frame random-dot kinematograms, that two quite different mechanisms operate simultaneously in the detection of such patterns. One mechanism causes reversal of the perceived direction (reversed-phi motion) when the image contrast is reversed between frames, and is highly dependent on the spatial-frequency content of the image. These characteristics are both signatures of detection based on motion energy. The other mechanism does not produce reversed-phi motion and is unaffected by spatial filtering. This appears to involve the tracking of unsigned complex spatial features. The perceived direction of a filtered dot pattern typically reflects a mixture of the two types of behaviour in any given instance. Although both types of mechanism have previously been invoked to explain the perception of motion of different types of image, the simultaneous involvement of two mechanisms in the detection of the same simple rigid motion of a pattern suggests that motion perception in general results from a combination of mechanisms working simultaneously on different principles in the same circumstances.     

The consistency of element transformations affects the visibility but not the direction of illusory motion

Two experiments tested whether the consistency of element transformations affected perceptions of long-range apparent motion. Vertical lines were used to generate apparent motion against one of two different backgrounds, control and depth. Consistency was manipulated by changing the size of the vertical lines. In some displays, the size of the vertical lines remained constant during movement. In other displays, the size of the vertical lines changed during movement. Consistent movement occurred when the size manipulation was in agreement with the type of background used. In Experiment I, points of subject equality for the quality of motion relative to a standard display were measured. These PSEs indicated that consistent movement (e.g., line sizes held constant for control background displays) was more visible than inconsistent movement (e.g., line sizes constant for depth background displays). In Experiment II, a motion competition display was used to measure thresholds for perceived direction of motion. The depth background was used to make motion in one direction more consistent than motion in the opposite direction. However, no significant differences were noted between thresholds obtained in this condition and those obtained in a control condition. Thus the consistency of element transformations affected the quality of motion, but did not affect the perceived direction of motion. These results are consistent with Ullman's (The Interpretation of Visual Motion, MIT Press, 1979) two-component theory of apparent motion.     

The detection of real and apparent motion by the crabLeptograpsus variegatus

Summary Optokinetic eye movements can be evoked in rock crabs either by real or apparent motion of the visual field. For wide-field striped stimuli, the apparent motion stimulus is less effective than the real motion but for narrow field light-spot stimuli, intensity is an important factor: at low light intensities real motion is still a more effective stimulus but at high light intensities the opposite is true. The crab's complex response to apparent motion appears to be dominated by the combination of two central mechanisms, one of which decays exponentially during the Dark period, and one which becomes resensitized, after a short delay, in the dark.Supported by the Deutsche Forschungsgemeinschaft ER 79/1     

Interocular motion combination for dichoptic moving stimuli

When gratings moving in different directions are presented separately to the two eyes, we typically perceive periods of the combination of motion in the two eyes as well as periods of one or the other monocular motions. To investigate whether such interocular motion combination is determined by the intersection-of-constraints (IOC) or vector average mechanism, we recorded both optokinetic nystagmus eye movements (OKN) and perception during dichoptic presentation of moving gratings and random-dot patterns with various differences of interocular motion direction. For moving gratings, OKN alternately tracks not only the direction of the two monocular motions but also the direction of their combined motion. The OKN in the combined motion direction is highly correlated with the perceived direction of combined motion; its velocity complies with the IOC rule rather than the vector average of the dichoptic motion stimuli. For moving random-dot patterns, both OKN and perceived motion alternate only between the directions of the two monocular motions. These results suggest that interocular motion combination in dichoptic gratings is determined by the IOC and depends on their form.     

Motion edges and regions guide image segmentation by colour.

Image segmentation is an important early stage in visual processing in which the visual system groups together parts of the image that belong together, prior to or in conjunction with object recognition. Two principal processes may be involved in image segmentation: an edge-based process that uses feature contrasts to mark boundaries of coherent regions, and a region-based process that groups similar features over a larger scale. Earlier, we have shown that motion and colour interact strongly in image segmentation by the human visual system. Here we explore the nature of this interaction in terms of edge- and region-based processes. We measure performance on a region-based colour segmentation task in the presence of distinct types of motion information, in the form of edges and regions which in themselves do not reveal the location of the colour target. The results show that both motion edges and regions may guide the integrative process required for this colour segmentation task. Motion edges appear to act by delimiting areas over which to integrate colour information, whereas motion similarities define primitive surfaces within which colour grouping and segmentation processes are deployed.     

Do variables that affect similar bistable apparent-movement displays result in similar changes in perception?

Two bistable apparent-movement displays (i.e. ones that generate two qualitatively different kinds of movement percepts under different conditions) were compared. They were designed to be as similar as possible spatially, and were studied with identical stimulus manipulations to see whether changes in balance between their bistable percepts would be similar. Results show that the two displays had different response characteristics to the same stimulus manipulations. Two models of motion perception that have previously predicted at least one kind of bistable apparent motion were considered in terms of how well they address the current data. As yet, neither model has been shown to predict the motion states and bistable behavior of the two displays studied here. It is concluded that results of the type described here (specifically, differences in the psychophysical functions yielded by two structurally similar but qualitatively different bistable displays) present a challenge for theories of motion perception.     

The Temporal Structure of Behaviour and Sleep Homeostasis

The amount and architecture of vigilance states are governed by two distinct processes, which occur at different time scales. The first, a slow one, is related to a wake/sleep dependent homeostatic Process S, which occurs on a time scale of hours, and is reflected in the dynamics of NREM sleep EEG slow-wave activity. The second, a fast one, is manifested in a regular alternation of two sleep states – NREM and REM sleep, which occur, in rodents, on a time scale of ∼5–10 minutes. Neither the mechanisms underlying the time constants of these two processes – the slow one and the fast one, nor their functional significance are understood. Notably, both processes are primarily apparent during sleep, while their potential manifestation during wakefulness is obscured by ongoing behaviour. Here, we find, in mice provided with running wheels, that the two sleep processes become clearly apparent also during waking at the level of behavior and brain activity. Specifically, the slow process was manifested in the total duration of waking periods starting from dark onset, while the fast process was apparent in a regular occurrence of running bouts during the waking periods. The dynamics of both processes were stable within individual animals, but showed large interindividual variability. Importantly, the two processes were not independent: the periodic structure of waking behaviour (fast process) appeared to be a strong predictor of the capacity to sustain continuous wakefulness (slow process). The data indicate that the temporal organization of vigilance states on both the fast and the slow time scales may arise from a common neurophysiologic mechanism.     

Changes of mind in an attractor network of decision-making

Attractor networks successfully account for psychophysical and neurophysiological data in various decision-making tasks. Especially their ability to model persistent activity, a property of many neurons involved in decision-making, distinguishes them from other approaches. Stable decision attractors are, however, counterintuitive to changes of mind. Here we demonstrate that a biophysically-realistic attractor network with spiking neurons, in its itinerant transients towards the choice attractors, can replicate changes of mind observed recently during a two-alternative random-dot motion (RDM) task. Based on the assumption that the brain continues to evaluate available evidence after the initiation of a decision, the network predicts neural activity during changes of mind and accurately simulates reaction times, performance and percentage of changes dependent on difficulty. Moreover, the model suggests a low decision threshold and high incoming activity that drives the brain region involved in the decision-making process into a dynamical regime close to a bifurcation, which up to now lacked evidence for physiological relevance. Thereby, we further affirmed the general conformance of attractor networks with higher level neural processes and offer experimental predictions to distinguish nonlinear attractor from linear diffusion models.     

Attention to surfaces modulates motion processing in extrastriate area MT

In the visual system, early atomized representations are grouped into higher-level entities through processes of perceptual organization. Here we present neurophysiological evidence that a representation of a simple object, a surface defined by color and motion, can be the unit of attentional selection at an early stage of visual processing. Monkeys were cued by the color of a fixation spot to attend to one of two transparent random-dot surfaces, one red and one green, which occupied the same region of space. Motion of the attended surface drove neurons in the middle temporal (MT) visual area more strongly than physically identical motion of the non-attended surface, even though both occurred within the spotlight of attention. Surface-based effects of attention persisted even without differential surface coloring, but attentional modulation was stronger with color. These results show that attention can select surface representations to modulate visual processing as early as cortical area MT.     

Visual detection of paradoxical motion in flies

Summary From psychophysics it is known that humans easily perceive motion in Fourier-stimuli in which dots are displaced coherently into one direction. Furthermore, motion can be extracted from Drift-balanced stimuli in which the dots on average have no distinct direction of motion, or even in paradox -motion stimuli where the dots are displaced opposite to the perceived direction of motion. Whereas Fourier-motion can be explained by very basic motion detectors and nonlinear preprocessing of the input can account for the detection of Drift-balanced motion, a hierarchical model with two layers of motion detectors was proposed to explain the perception of -motion. The well described visual system of the fly allows to investigate whether these complex motion stimuli can be detected in a comparatively simple brain.The detection of such motion stimuli was analyzed for various random-dot cinematograms with extracellular recordings from the motion-sensitive Hl-neuron in the third visual ganglion of the blowfly Calliphora erythrocephala. The results were compared to computer-simulations of a hierarchical model of motion detector networks.For Fourier- and Drift-balanced motion stimuli, the Hl-neuron responds directionally selective to the moving object, whereas for -motion stimuli, the preferred direction is given by the dot displacement. Assuming nonlinear preprocessing of the detector input, such as a half-wave rectification, elementary motion detectors of the correlation type can account for these results.Abbreviations EMD elementary motion detector     

Cooperative and non-cooperative processes of apparent movement of random-dot cinematograms

In this study, we investigated the cooperative and non-cooperative models of stereopsis on apparent movement of the short-range process using spatial frequency filtered random-dot cinematograms. Our results showed that when spatial frequencies were below 4 cycles/degree, maximum displacement (dmax) was decreasing (linearly) with increasing mean frequencies, but at 4 cycles/degree and above dmax stayed constant. For low frequencies, non-cooperative models such as Marr and Poggio's could explain these findings, but not for frequencies above 4 cycles/degree. However, in a previous study we found that the average cooperative neighbourhood for apparent movement of the short-range process is 15 arc min. This fortuitous agreement on 4 cycles/degree could suggest that dmax being constant at frequencies above 4 cycles is related to a cooperative process.     

Patterns of fMRI activity dissociate overlapping functional brain areas that respond to biological motion

Accurate perception of the actions and intentions of other people is essential for successful interactions in a social environment. Several cortical areas that support this process respond selectively in fMRI to static and dynamic displays of human bodies and faces. Here we apply pattern-analysis techniques to arrive at a new understanding of the neural response to biological motion. Functionally defined body-, face-, and motion-selective visual areas all responded significantly to "point-light" human motion. Strikingly, however, only body selectivity was correlated, on a voxel-by-voxel basis, with biological motion selectivity. We conclude that (1) biological motion, through the process of structure-from-motion, engages areas involved in the analysis of the static human form; (2) body-selective regions in posterior fusiform gyrus and posterior inferior temporal sulcus overlap with, but are distinct from, face- and motion-selective regions; (3) the interpretation of region-of-interest findings may be substantially altered when multiple patterns of selectivity are considered.