Motion adaptation distorts perceived visual position

After an observer adapts to a moving stimulus, texture within a stationary stimulus is perceived to drift in the opposite direction-the traditional motion aftereffect (MAE). It has recently been shown that the perceived position of objects can be markedly influenced by motion adaptation. In the present study, we examine the selectivity of positional shifts resulting from motion adaptation to stimulus attributes such as velocity, relative contrast, and relative spatial frequency. In addition, we ask whether spatial position can be modified in the absence of perceived motion. Results show that when adapting and test stimuli have collinear carrier gratings, the global position of the object shows a substantial shift in the direction of the illusory motion. When the carrier gratings of the adapting and test stimuli are orthogonal (a configuration in which no MAE is experienced), a global positional shift of similar magnitude is found. The illusory positional shift was found to be immune to changes in spatial frequency and to contrast between adapting and test stimuli-manipulations that dramatically reduce the magnitude of the traditional MAE. The lack of sensitivity for stimulus characteristics other than direction of motion suggests that a specialized population of cortical neurones, which are insensitive to changes in a number of rudimentary visual attributes, may modulate positional representation in lower cortical areas.     

Perceptual compression of space through position integration

The mechanism of positional localization has recently been debated due to interest in the flash-lag effect, which occurs when a briefly flashed stationary stimulus is perceived to lag behind a spatially aligned moving stimulus. Here we report positional localization observed at motion offsets as well as at onsets. In the 'flash-lead' effect, a moving object is perceived to be behind a spatially concurrent stationary flash before the two disappear. With 'reverse-repmo', subjects mis-localize the final position of a moving bar in the direction opposite to the trajectory of motion. Finally, we demonstrate that simultaneous onset and offset effects lead to a perceived compression of visual space. By characterizing illusory effects observed at motion offsets as well as at onsets, we provide evidence that the perceived position of a moving object is the result of an averaging process over a short time period, weighted towards the most recent positions. Our account explains a variety of motion illusions, including the compression of moving shapes when viewed through apertures.     

Human brain activity during illusory visual jitter as revealed by functional magnetic resonance imaging

One central problem in vision is how to compensate for retinal slip. A novel illusion (visual jitter) suggests the compensation mechanism is based solely on retinal motion. Adaptation to visual noise attenuates the motion signals used by the compensation stage, producing illusory jitter due to the undercompensation of retinal slip. Here, we investigated the neural substrate of retinal slip compensation during this illusion using high-field fMRI and retinotopic mapping in flattened cortical format. When jitter perception occurred, MR signal decreased in lower stages of the visual system but increased prominently in area MT+. In conclusion, visual areas as early as V1 are responsible for the adaptation stage, and MT+ is involved in the compensation stage. The present finding suggests the pathway from V1 to MT+ has an important role in stabilizing the visual world.     

Human cortical regions involved in extracting depth from motion

We used functional magnetic resonance imaging (fMRI) to investigate brain regions involved in extracting three-dimensional structure from motion. A factorial design included two-dimensional and three-dimensional structures undergoing rigid and nonrigid motions. As predicted from monkey data, the human homolog of MT/V5 was significantly more active when subjects viewed three-dimensional (as opposed to two-dimensional) displays, irrespective of their rigidity. Human MT/V5+ (hMT/V5+) is part of a network with right hemisphere dominance involved in extracting depth from motion, including a lateral occipital region, five sites along the intraparietal sulcus (IPS), and two ventral occipital regions. Control experiments confirmed that this pattern of activation is most strongly correlated with perceived three-dimensional structure, in as much as it arises from motion and cannot be attributed to numerous two-dimensional image properties or to saliency.     

Viewer-centered object representation in the human visual system revealed by viewpoint aftereffects

Are there neurons representing specific views of objects in the human visual system? A visual selective adaptation method was used to address this question. After visual adaptation to an object viewed either 15 or 30 degrees from one side, when the same object was subsequently presented near the frontal view, the perceived viewing directions were biased in a direction opposite to that of the adapted viewpoint. This aftereffect can be obtained with spatially nonoverlapping adapting and test stimuli, and it depends on the global representation of the adapting stimuli. Viewpoint aftereffects were found within, but not across, categories of objects tested (faces, cars, wire-like objects). The magnitude of this aftereffect depends on the angular difference between the adapting and test viewing angles and grows with increasing duration of adaptation. These results support the existence of object-selective neurons tuned to specific viewing angles in the human visual system.     

Attention, adaptation, and the motion aftereffect

Activation of the human visual motion area V5/MT was previously thought to be the basis of the motion aftereffect. New findings suggest that previous observations were confounded by attention and arousal, providing evidence that adaptation of directionally selective neurons in area V5/MT represents the fundamental substrate for the motion aftereffect.     

Color signals in human motion-selective cortex

The neural basis for the effects of color and contrast on perceived speed was examined using functional magnetic resonance imaging (fMRI). Responses to S cone (blue-yellow) and L + M cone (luminance) patterns were measured in area V1 and in the motion area MT+. The MT+ responses were quantitatively similar to perceptual speed judgments of color patterns but not to color detection measures. We also measured cortical motion responses in individuals lacking L and M cone function (S cone monochromats). The S cone monochromats have clear motion-responsive regions in the conventional MT+ position, and their contrast-response functions there have twice the responsivity of S cone contrast-response functions in normal controls. But, their responsivity is far lower than the normals' responsivity to luminance contrast. Thus, the powerful magnocellular input to MT+ is either weak or silent during photopic vision in S cone monochromats.     

Spatio-temporal brain mapping of motion-onset VEPs combined with fMRI and retinotopic maps

Neuroimaging studies have identified several motion-sensitive visual areas in the human brain, but the time course of their activation cannot be measured with these techniques. In the present study, we combined electrophysiological and neuroimaging methods (including retinotopic brain mapping) to determine the spatio-temporal profile of motion-onset visual evoked potentials for slow and fast motion stimuli and to localize its neural generators. We found that cortical activity initiates in the primary visual area (V1) for slow stimuli, peaking 100 ms after the onset of motion. Subsequently, activity in the mid-temporal motion-sensitive areas, MT+, peaked at 120 ms, followed by peaks in activity in the more dorsal area, V3A, at 160 ms and the lateral occipital complex at 180 ms. Approximately 250 ms after stimulus onset, activity fast motion stimuli was predominant in area V6 along the parieto-occipital sulcus. Finally, at 350 ms (100 ms after the motion offset) brain activity was visible again in area V1. For fast motion stimuli, the spatio-temporal brain pattern was similar, except that the first activity was detected at 70 ms in area MT+. Comparing functional magnetic resonance data for slow vs. fast motion, we found signs of slow-fast motion stimulus topography along the posterior brain in at least three cortical regions (MT+, V3A and LOR).     

Dynamic shape integration in extrastriate cortex

BACKGROUND: In anorthoscopic viewing conditions, observers can perceive a moving object through a narrow slit even when only portions of its contour are visible at any time. We used fMRI to examine the contribution of early and later visual cortical areas to dynamic shape integration. Observers' success at integrating the shape of the slit-viewed object was manipulated by varying the degree to which the stimulus was dynamically distorted. Line drawings of common objects were either moderately distorted, strongly distorted, or shown undistorted. Phenomenologically, increasing the stimulus distortion made both object shape and motion more difficult to perceive.RESULTS: We found that bilateral cortical activity in portions of the ventral occipital cortex, corresponding to known object areas within the lateral occipital complex (LOC), was inversely correlated with the degree of stimulus distortion. We found that activity in left MT+, the human cortical area specialized for motion, showed a similar pattern as the ventral occipital region. The LOC also showed greater activity to a fully visible moving object than to the undistorted slit-viewed object. Area MT+, however, showed more equivalent activity to both the slit-viewed and fully visible moving objects.CONCLUSIONS: In early retinotopic cortex, the distorted and undistorted stimuli elicited the same amount of activity. Higher visual areas, however, were correlated with the percept of the coherent object, and this correlation suggests that the shape integration is mediated by later visual cortical areas. Motion information from the dorsal stream may project to the LOC to produce the shape percept.     

Cerebral visual motion blindness: transitory akinetopsia induced by transcranial magnetic stimulation of human area V5.

The perception of visual motion can be selectively and reversibly compromised by transcranial magnetic stimulation (TMS) of a small region of cortex, roughly 1 cm in diameter and corresponding in position to human area V5. The reversible inactivation of a small and specialized visual area which receives its predominant input from area V1 and sends a powerful return (re-entrant) input back to it allowed us to study for the first time the backward influence of area V5 on area V1. In contrast to the complete and temporary visual motion blindness which occurs during stimulation of V5, a less-prominent interference with the perception of visual motion occurs at 70-80 ms after the onset of the visual stimulus when TMS is applied to V1. Because V5 is critical for the perception of coherent motion, and because an intact re-entry of signals from V5 to V1 is essential for the conscious perception of visual motion, the results obtained with stimulation of V1 must be caused by a disruption of the re-entrant signals from V5 to V1.     

Sounds Move a Static Visual Object

Background

Vision provides the most salient information with regard to stimulus motion, but audition can also provide important cues that affect visual motion perception. Here, we show that sounds containing no motion or positional cues can induce illusory visual motion perception for static visual objects.

Methodology/Principal Findings

Two circles placed side by side were presented in alternation producing apparent motion perception and each onset was accompanied by a tone burst of a specific and unique frequency. After exposure to this visual apparent motion with tones for a few minutes, the tones became drivers for illusory motion perception. When the flash onset was synchronized to tones of alternating frequencies, a circle blinking at a fixed location was perceived as lateral motion in the same direction as the previously exposed apparent motion. Furthermore, the effect lasted at least for a few days. The effect was well observed at the retinal position that was previously exposed to apparent motion with tone bursts.

Conclusions/Significance

The present results indicate that strong association between sound sequence and visual motion is easily formed within a short period and that, after forming the association, sounds are able to trigger visual motion perception for a static visual object.     

Activation of Multimodal Areas in the Human Cerebral Cortex in Response to Biological Motion Sounds

Functional magnetic resonance imaging (fMRI) was used to investigate activation of the multimodal areas in the cerebral cortex–supramarginal and angular gyri, precuneus, and middle temporal visual cortex (MT/V5)–in response to motion of biologically significant sounds (human footsteps). The subjects listened to approaching or receding footstep sounds during 45 s, and such stimulation was supposed to evoke auditory adaptation to biological motion. Listening conditions alternated with stimulation-free control. To reveal activity in the regions of interest, the periods before and during stimulation were compared. Most stable and voluminous activation was detected in the supramarginal and angular gyri, being registered for all footstep sound types–approaching, receding and steps in place. Listening to human approaching steps activated the precuneus area, with the volume of activation clusters varying considerably between subjects. In the MT/V5 area, activation was revealed in 5 of 21 subjects. The involvement of the tested multimodal cortical areas in analyzing biological motion is discussed.     

End-stopping and the aperture problem: two-dimensional motion signals in macaque V1

Our perception of fine visual detail relies on small receptive fields at early stages of visual processing. However, small receptive fields tend to confound the orientation and velocity of moving edges, leading to ambiguous or inaccurate motion measurements (the aperture problem). Thus, it is often assumed that neurons in primary visual cortex (V1) carry only ambiguous motion information. Here we show that a subpopulation of V1 neurons is capable of signaling motion direction in a manner that is independent of contour orientation. Specifically, end-stopped V1 neurons obtain accurate motion measurements by responding only to the endpoints of long contours, a strategy which renders them largely immune to the aperture problem. Furthermore, the time course of end-stopping is similar to the time course of motion integration by MT neurons. These results suggest that cortical neurons might represent object motion by responding selectively to two-dimensional discontinuities in the visual scene.     

Progressive Thinning of Visual Cortex in Primary Open-Angle Glaucoma of Varying Severity

The aim of this study was to investigate possible changes of cortical thickness in the visual cortex in primary open-angle glaucoma (POAG) of varying severity. Twenty normal controls (NC), 20 mild (MP) and 17 severe (SP) POAG patients were recruited and scanned using magnetic resonance imaging. Cortical thickness analyses with regions of interest (V1, V2, ventral V3, V4 and V5/MT+) were used to assess the cortical changes among the three groups. Furthermore, the associations of cortical thickness with retinal nerve fiber layer (RNFL) thickness and mean deviation of visual field were analyzed. Compared with the NC group, decreased cortical thickness was detected in the bilateral V5/MT+ areas in the MP group and the left V1, bilateral V2 and V5/MT+ areas in the SP group. Cortical thinning of the bilateral V2 areas was detected in the SP group compared with the MP group. In addition, cortical thinning of these visual areas was related to the ophthalmologic measurements. In conclusion, POAG patients exhibit cortical thinning in the bilateral V5/MT+ in the early stage of disease. The cortical degeneration in visual areas is discrepant with disease progressing and the dorsal pathway might be selectively damaged in POAG. Therefore, the cortical thinning of these visual areas may play a key role in the progression of POAG and can serve as a novel biomarker for accurately evaluating the severity of POAG.     

The functional neuroanatomy of implicit-motion perception or representational momentum

BACKGROUND: When we view static scenes that imply motion - such as an object dropping off a shelf - recognition memory for the position of the object is extrapolated forward. It is as if the object in our mind's eye comes alive and continues on its course. This phenomenon is known as representational momentum and results in a distortion of recognition memory in the implied direction of motion. Representational momentum is modifiable; simply labelling a drawing of a pointed object as 'rocket' will facilitate the effect, whereas the label 'steeple' will impede it. We used functional magnetic resonance imaging (fMRI) to explore the neural substrate for representational momentum. RESULTS: Subjects participated in two experiments. In the first, they were presented with video excerpts of objects in motion (versus the same objects in a resting position). This identified brain areas responsible for motion perception. In the second experiment, they were presented with still photographs of the same target items, only some of which implied motion (representational momentum stimuli). When viewing still photographs of scenes implying motion, activity was revealed in secondary visual cortical regions that overlap with areas responsible for the perception of actual motion. Additional bilateral activity was revealed within a posterior satellite of V5 for the representational momentum stimuli. Activation was also engendered in the anterior cingulate cortex. CONCLUSIONS: Considering the implicit nature of representational momentum and its modifiability, the findings suggest that higher-order semantic information can act on secondary visual cortex to alter perception without explicit awareness.     

Laminar cortical dynamics of visual form and motion interactions during coherent object motion perception

How do visual form and motion processes cooperate to compute object motion when each process separately is insufficient? Consider, for example, a deer moving behind a bush. Here the partially occluded fragments of motion signals available to an observer must be coherently grouped into the motion of a single object. A 3D FORMOTION model comprises five important functional interactions involving the brain's form and motion systems that address such situations. Because the model's stages are analogous to areas of the primate visual system, we refer to the stages by corresponding anatomical names. In one of these functional interactions, 3D boundary representations, in which figures are separated from their backgrounds, are formed in cortical area V2. These depth-selective V2 boundaries select motion signals at the appropriate depths in MT via V2-to-MT signals. In another, motion signals in MT disambiguate locally incomplete or ambiguous boundary signals in V2 via MT-to-V1-to-V2 feedback. The third functional property concerns resolution of the aperture problem along straight moving contours by propagating the influence of unambiguous motion signals generated at contour terminators or corners. Here, sparse 'feature tracking signals' from, for example, line ends are amplified to overwhelm numerically superior ambiguous motion signals along line segment interiors. In the fourth, a spatially anisotropic motion grouping process takes place across perceptual space via MT-MST feedback to integrate veridical feature-tracking and ambiguous motion signals to determine a global object motion percept. The fifth property uses the MT-MST feedback loop to convey an attentional priming signal from higher brain areas back to V1 and V2. The model's use of mechanisms such as divisive normalization, endstopping, cross-orientation inhibition, and long-range cooperation is described. Simulated data include: the degree of motion coherence of rotating shapes observed through apertures, the coherent vs. element motion percepts separated in depth during the chopsticks illusion, and the rigid vs. nonrigid appearance of rotating ellipses.     

Crowding: a cortical constraint on object recognition

The external world is mapped retinotopically onto the primary visual cortex (V1). We show here that objects in the world, unless they are very dissimilar, can be recognized only if they are sufficiently separated in visual cortex: specifically, in V1, at least 6mm apart in the radial direction (increasing eccentricity) or 1mm apart in the circumferential direction (equal eccentricity). Objects closer together than this critical spacing are perceived as an unidentifiable jumble. This is called 'crowding'. It severely limits visual processing, including speed of reading and searching. The conclusion about visual cortex rests on three findings. First, psychophysically, the necessary 'critical' spacing, in the visual field, is proportional to (roughly half) the eccentricity of the objects. Second, the critical spacing is independent of the size and kind of object. Third, anatomically, the representation of the visual field on the cortical surface is such that the position in V1 (and several other areas) is the logarithm of eccentricity in the visual field. Furthermore, we show that much of this can be accounted for by supposing that each 'combining field', defined by the critical spacing measurements, is implemented by a fixed number of cortical neurons.     

Task-specific impairments and enhancements induced by magnetic stimulation of human visual area V5.

Transcranial magnetic stimulation (TMS) can be used to simulate the effects of highly circumscribed brain damage permanently present in some neuropsychological patients, by reversibly disrupting the normal functioning of the cortical area to which it is applied. By using TMS we attempted to recreate deficits similar to those reported in a motion-blind patient and to assess the specificity of deficits when TMS is applied over human area V5. We used six visual search tasks and showed that subjects were impaired in a motion but not a form ''pop-out'' task when TMS was applied over V5. When motion was present, but irrelevant, or when attention to colour and form were required, TMS applied to V5 enhanced performance. When attention to motion was required in a motion-form conjunction search task, irrespective of whether the target was moving or stationary, TMS disrupted performance. These data suggest that attention to different visual attributes involves mutual inhibition between different extrastriate visual areas.     

BOLD Response Selective to Flow-Motion in Very Young Infants

In adults, motion perception is mediated by an extensive network of occipital, parietal, temporal, and insular cortical areas. Little is known about the neural substrate of visual motion in infants, although behavioural studies suggest that motion perception is rudimentary at birth and matures steadily over the first few years. Here, by measuring Blood Oxygenated Level Dependent (BOLD) responses to flow versus random-motion stimuli, we demonstrate that the major cortical areas serving motion processing in adults are operative by 7 wk of age. Resting-state correlations demonstrate adult-like functional connectivity between the motion-selective associative areas, but not between primary cortex and temporo-occipital and posterior-insular cortices. Taken together, the results suggest that the development of motion perception may be limited by slow maturation of the subcortical input and of the cortico-cortical connections. In addition they support the existence of independent input to primary (V1) and temporo-occipital (V5/MT+) cortices very early in life.     

Dissociation of neuronal and psychophysical responses to local and global motion

Most neurons in cortical area MT (V5) are strongly direction selective, and their activity is closely associated with the perception of visual motion. These neurons have large receptive fields built by combining inputs with smaller receptive fields that respond to local motion. Humans integrate motion over large areas and can perceive what has been referred to as global motion. The large size and direction selectivity of MT receptive fields suggests that MT neurons may represent global motion. We have explored this possibility by measuring responses to a stimulus in which the directions of simultaneously presented local and global motion are independently controlled. Surprisingly, MT responses depended only on the local motion and were unaffected by the global motion. Yet, under similar conditions, human observers perceive global motion and are impaired in discriminating local motion. Although local motion perception might depend on MT signals, global motion perception depends on mechanisms qualitatively different from those in MT. Motion perception therefore does not depend on a single cortical area but reflects the action and interaction of multiple brain systems.