Interrelation of kinetic and stereoscopic depth: behavior and physiology in vertebrates

The target article gathers compelling behavioral evidence that motion parallax provides depth information in a variety of animal species. A more general evaluation of kinetic depth cues subserving depth perception would call attention to recent studies in monkeys, demonstrating the interrelation of kinetic and stereoscopic depth cues both on a behavioral and physiological level. Furthermore, it is argued that binocularity in birds has a clear function in stereopsis.     

Hawk Eyes II: Diurnal Raptors Differ in Head Movement Strategies When Scanning from Perches

Background

Relatively little is known about the degree of inter-specific variability in visual scanning strategies in species with laterally placed eyes (e.g., birds). This is relevant because many species detect prey while perching; therefore, head movement behavior may be an indicator of prey detection rate, a central parameter in foraging models. We studied head movement strategies in three diurnal raptors belonging to the Accipitridae and Falconidae families.

Methodology/Principal Findings

We used behavioral recording of individuals under field and captive conditions to calculate the rate of two types of head movements and the interval between consecutive head movements. Cooper''s Hawks had the highest rate of regular head movements, which can facilitate tracking prey items in the visually cluttered environment they inhabit (e.g., forested habitats). On the other hand, Red-tailed Hawks showed long intervals between consecutive head movements, which is consistent with prey searching in less visually obstructed environments (e.g., open habitats) and with detecting prey movement from a distance with their central foveae. Finally, American Kestrels have the highest rates of translational head movements (vertical or frontal displacements of the head keeping the bill in the same direction), which have been associated with depth perception through motion parallax. Higher translational head movement rates may be a strategy to compensate for the reduced degree of eye movement of this species.

Conclusions

Cooper''s Hawks, Red-tailed Hawks, and American Kestrels use both regular and translational head movements, but to different extents. We conclude that these diurnal raptors have species-specific strategies to gather visual information while perching. These strategies may optimize prey search and detection with different visual systems in habitat types with different degrees of visual obstruction.     

Enhancement of Glossiness Perception by Retinal-Image Motion: Additional Effect of Head-Yoked Motion Parallax

It has been argued that when an observer moves, a contingent retinal-image motion of a stimulus would strengthen the perceived glossiness. This would be attributed to the veridical perception of three-dimensional structure by motion parallax. However, it has not been investigated whether the effect of motion parallax is more than that of retinal-image motion of the stimulus. Using a magnitude estimation method, we examine in this paper whether cross-modal coordination of the stimulus change and the observer''s motion (i.e., motion parallax) is essential or the retinal-image motion alone is sufficient for enhancing the perceived glossiness. Our data show that a retinal-image motion simulating motion parallax without head motion strengthened the perceived glossiness but that its effect was weaker than that of motion parallax with head motion. These results suggest the existence of an additional effect of the cross-modal coordination between vision and proprioception on glossiness perception. That is, motion parallax enhances the perception of glossiness, in addition to retinal-image motions of specular surfaces.     

Motion parallax contribution to perception of self-motion and depth

The object of this study is to mathematically specify important characteristics of visual flow during translation of the eye for the perception of depth and self-motion. We address various strategies by which the central nervous system may estimate self-motion and depth from motion parallax, using equations for the visual velocity field generated by translation of the eye through space. Our results focus on information provided by the movement and deformation of three-dimensional objects and on local flow behavior around a fixated point. All of these issues are addressed mathematically in terms of definite equations for the optic flow. This formal characterization of the visual information presented to the observer is then considered in parallel with other sensory cues to self-motion in order to see how these contribute to the effective use of visual motion parallax, and how parallactic flow can, conversely, contribute to the sense of self-motion. This article will focus on a central case, for understanding of motion parallax in spacious real-world environments, of monocular visual cues observable during pure horizontal translation of the eye through a stationary environment. We suggest that the global optokinetic stimulus associated with visual motion parallax must converge in significant fashion with vestibular and proprioceptive pathways that carry signals related to self-motion. Suggestions of experiments to test some of the predictions of this study are made.     

The Visual Orientation Strategies of Mantis religiosa and Empusa fasciata Reflect Differences in the Structure of Their Visual Surroundings

In the present study, peering behaviour, which is used to measure distance by the image motion caused by head movement, is examined in two types of mantid. Mantis religiosa inhabits a region of dense grass consisting of uniform, generally uniformly aligned, and closely spaced elements and executes slow, simple peering movements. In contrast, Empusa fasciata climbs about in open regions of shrubs and bushes which consist of irregular, variably aligned and variably spaced elements and it executes comparatively quick, complex peering movements. Hence, it seems that in these two species of mantid, the same orientation mechanism has been adapted to the unique structures of their visual surroundings. Apparently M. religiosa uses motion parallax and E. fasciata uses a combination of motion parallax and forward and backward movements (image expansion/contraction over time) to detect object distances.     

Bumblebee Homing: The Fine Structure of Head Turning Movements

Changes in flight direction in flying insects are largely due to roll, yaw and pitch rotations of their body. Head orientation is stabilized for most of the time by counter rotation. Here, we use high-speed video to analyse head- and body-movements of the bumblebee Bombus terrestris while approaching and departing from a food source located between three landmarks in an indoor flight-arena. The flight paths consist of almost straight flight segments that are interspersed with rapid turns. These short and fast yaw turns (“saccades”) are usually accompanied by even faster head yaw turns that change gaze direction. Since a large part of image rotation is thereby reduced to brief instants of time, this behavioural pattern facilitates depth perception from visual motion parallax during the intersaccadic intervals. The detailed analysis of the fine structure of the bees’ head turning movements shows that the time course of single head saccades is very stereotypical. We find a consistent relationship between the duration, peak velocity and amplitude of saccadic head movements, which in its main characteristics resembles the so-called "saccadic main sequence" in humans. The fact that bumblebee head saccades are highly stereotyped as in humans, may hint at a common principle, where fast and precise motor control is used to reliably reduce the time during which the retinal images moves.     

Visual gaze control during peering flight manoeuvres in honeybees

As animals travel through the environment, powerful reflexes help stabilize their gaze by actively maintaining head and eyes in a level orientation. Gaze stabilization reduces motion blur and prevents image rotations. It also assists in depth perception based on translational optic flow. Here we describe side-to-side flight manoeuvres in honeybees and investigate how the bees’ gaze is stabilized against rotations during these movements. We used high-speed video equipment to record flight paths and head movements in honeybees visiting a feeder. We show that during their approach, bees generate lateral movements with a median amplitude of about 20 mm. These movements occur with a frequency of up to 7 Hz and are generated by periodic roll movements of the thorax with amplitudes of up to ±60°. During such thorax roll oscillations, the head is held close to horizontal, thereby minimizing rotational optic flow. By having bees fly through an oscillating, patterned drum, we show that head stabilization is based mainly on visual motion cues. Bees exposed to a continuously rotating drum, however, hold their head fixed at an oblique angle. This result shows that although gaze stabilization is driven by visual motion cues, it is limited by other mechanisms, such as the dorsal light response or gravity reception.     

Motion parallax as a source of distance information in locusts and mantids

This review article is devoted to results on distance measurement in locusts (e.g., Wallace, 1959; Collett, 1978; Sobel, 1990) and mantids. Before locusts or mantids jump toward a stationary object, they perform characteristic pendulum movements with the head or body, called peering movements, in the direction of the object. The fact that the animals over- or underestimate the distance to the object when the object is moved with or against the peering movement, and so perform jumps that are too long or short, would seem to indicate that motion parallax is used in this distance measurement. The behavior of the peering parameters with different object distances also indicates that not only retinal image motion but also the animal’s own movement is used in calculating the distance.     

Visual fields, eye movements, and scanning behavior of a sit-and-wait predator, the black phoebe (Sayornis nigricans)

Foraging mode influences the dominant sensory modality used by a forager and likely the strategies of information gathering used in foraging and anti-predator contexts. We assessed three components of visual information gathering in a sit-and-wait avian predator, the black phoebe (Sayornis nigricans): configuration of the visual field, degree of eye movement, and scanning behavior through head-movement rates. We found that black phoebes have larger lateral visual fields than similarly sized ground-foraging passerines, as well as relatively narrower binocular and blind areas. Black phoebes moved their eyes, but eye movement amplitude was relatively smaller than in other passerines. Black phoebes may compensate for eye movement constraints with head movements. The rate of head movements increased before attacking prey in comparison to non-foraging contexts and before movements between perches. These findings suggest that black phoebes use their lateral visual fields, likely subtended by areas of high acuity in the retina, to track prey items in a three-dimensional space through active head movements. These head movements may increase depth perception, motion detection and tracking. Studying information gathering through head movement changes, rather than body posture changes (head-up, head-down) as generally presented in the literature, may allow us to better understand the mechanisms of information gathering from a comparative perspective.     

Considerations on the use of video playbacks as visual stimuli: the Lisbon workshop consensus

This paper is the consensus of a workshop that critically evaluated the utility and problems of video playbacks as stimuli in studies of visual behavior. We suggest that video playback is probably suitable for studying motion, shape, texture, size, and brightness. Studying color is problematic because video systems are specifically designed for humans. Any difference in color perception must lead to a different color sensation in most animals. Another potentially problematic limitation of video images is that they lack depth cues derived from stereopsis, accommodation, and motion parallax. Nonetheless, when used appropriately, video playback allows an unprecedented range of questions in visual communication to be addressed. It is important to note that most of the potential limitations of video playback are not unique to this technique but are relevant to all studies of visual signaling in animals. Received: 20 October 1999 / Accepted: 5 November 1999     

Visual deprivation and distance estimation in the praying mantis larva

Abstract. Young larvae of the praying mantis, Tenodera sinensis Saussure, were placed on an off-centre island surrounded by a round arena with six black bars painted on a white inner wall. In this situation, it was shown that the horizontal peering movements of the head often seen in mantids are in fact used to measure distances; motion parallax may be involved in this process. Aimed jumps that followed peering were taken to be the distinct result of an absolute distance measurement. Specific visual deprivation such as painting over of certain parts of the eye with opaque black varnish or degeneration of the fovea with sulforhodamine showed that: absolute evaluation of distance is only possible with two fully intact eyes; the peering mechanism is under visual control; and visual experience has a long-term effect on distance measurement involving peering movements.     

Effect of pictorial depth cues, binocular disparity cues and motion parallax depth cues on lightness perception in three-dimensional virtual scenes

Background

Surface lightness perception is affected by scene interpretation. There is some experimental evidence that perceived lightness under bi-ocular viewing conditions is different from perceived lightness in actual scenes but there are also reports that viewing conditions have little or no effect on perceived color. We investigated how mixes of depth cues affect perception of lightness in three-dimensional rendered scenes containing strong gradients of illumination in depth.

Methodology/Principal Findings

Observers viewed a virtual room (4 m width×5 m height×17.5 m depth) with checkerboard walls and floor. In four conditions, the room was presented with or without binocular disparity (BD) depth cues and with or without motion parallax (MP) depth cues. In all conditions, observers were asked to adjust the luminance of a comparison surface to match the lightness of test surfaces placed at seven different depths (8.5–17.5 m) in the scene. We estimated lightness versus depth profiles in all four depth cue conditions. Even when observers had only pictorial depth cues (no MP, no BD), they partially but significantly discounted the illumination gradient in judging lightness. Adding either MP or BD led to significantly greater discounting and both cues together produced the greatest discounting. The effects of MP and BD were approximately additive. BD had greater influence at near distances than far.

Conclusions/Significance

These results suggest the surface lightness perception is modulated by three-dimensional perception/interpretation using pictorial, binocular-disparity, and motion-parallax cues additively. We propose a two-stage (2D and 3D) processing model for lightness perception.     

Depth Perception Not Found in Human Observers for Static or Dynamic Anti-Correlated Random Dot Stereograms

One of the greatest challenges in visual neuroscience is that of linking neural activity with perceptual experience. In the case of binocular depth perception, important insights have been achieved through comparing neural responses and the perception of depth, for carefully selected stimuli. One of the most important types of stimulus that has been used here is the anti-correlated random dot stereogram (ACRDS). In these stimuli, the contrast polarity of one half of a stereoscopic image is reversed. While neurons in cortical area V1 respond reliably to the binocular disparities in ACRDS, they do not create a sensation of depth. This discrepancy has been used to argue that depth perception must rely on neural activity elsewhere in the brain. Currently, the psychophysical results on which this argument rests are not clear-cut. While it is generally assumed that ACRDS do not support the perception of depth, some studies have reported that some people, some of the time, perceive depth in some types of these stimuli. Given the importance of these results for understanding the neural correlates of stereopsis, we studied depth perception in ACRDS using a large number of observers, in order to provide an unambiguous conclusion about the extent to which these stimuli support the perception of depth. We presented observers with random dot stereograms in which correlated dots were presented in a surrounding annulus and correlated or anti-correlated dots were presented in a central circular region. While observers could reliably report the depth of the central region for correlated stimuli, we found no evidence for depth perception in static or dynamic anti-correlated stimuli. Confidence ratings for stereoscopic perception were uniformly low for anti-correlated stimuli, but showed normal variation with disparity for correlated stimuli. These results establish that the inability of observers to perceive depth in ACRDS is a robust phenomenon.     

Bayesian processing of vestibular information

Complex self-motion stimulations in the dark can be powerfully disorienting and can create illusory motion percepts. In the absence of visual cues, the brain has to use angular and linear acceleration information provided by the vestibular canals and the otoliths, respectively. However, these sensors are inaccurate and ambiguous. We propose that the brain processes these signals in a statistically optimal fashion, reproducing the rules of Bayesian inference. We also suggest that this processing is related to the statistics of natural head movements. This would create a perceptual bias in favour of low velocity and acceleration. We have constructed a Bayesian model of self-motion perception based on these assumptions. Using this model, we have simulated perceptual responses to centrifugation and off-vertical axis rotation and obtained close agreement with experimental findings. This demonstrates how Bayesian inference allows to make a quantitative link between sensor noise and ambiguities, statistics of head movement, and the perception of self-motion.     

Vision: can colour contribute to motion?

Whether colour patterns that have no luminance variation can evoke the perception of visual motion has long been a controversial issue. Recent studies using new and old techniques have now provided compelling evidence that colour can indeed contribute to motion perception.     

Depth generalization from stereo to motion parallax in the owl

Although many sources of three-dimensional information have been isolated and demonstrated to contribute independently, to depth vision in animal studies, it is not clear whether these distinct cues are perceived to be perceptually equivalent. Such ability is observed in humans and would seem to be advantageous for animals as well in coping with the often co-varying (or ambiguous) information about the layout of physical space. We introduce the expression primary-depth-cue equivalence to refer to the ability to perceive mutually consistent information about differences in depth from either stereopsis or motion-parallax. We found that owls trained to detect relative depth as a perceptual category (objects versus holes) when specified by binocular disparity alone (stereopsis), immediately transferred this discrimination to novel stimuli where the equivalent depth categories were available only through differences in motion information produced by head movements (observer-produced motion-parallax). Motion-parallax discrimination did occur under monocular viewing conditions and reliable performance depended heavily on the amplitude of side-to-side head movements. The presence of primary-depth-cue equivalence in the visual system of the owl provides further conformation of the hypothesis that neural systems evolved to detect differences in either disparity or motion information are likely to share similar processing mechanisms.     

Eye Movements Induced by Changes in the Internal Representation of Body Posture

Oculomotor responses to body rotation were investigated in subjects standing with the eyes closed. A rotatable platform was used to provide body rotation relative to the space-stationary head or upper part of the body (fixation of the head; the head and the shoulders; and the head, the shoulders, and the pelvis). A slow rotation of the body about the longitudinal axis by ±6.5° within 10–150 s evoked an illusion of the upper part of the body turning in space, while the moving footplate was perceived as stationary in space. This illusion was accompanied by marked eye movements in the direction of the illusory rotation. In subjects grasping a rigid ground-based handle, the perception of body movements corresponded to the actual rotation of body parts. In this case, the amplitude of eye movements was substantially lower. It was concluded that the eye movement pattern depends not only on the actual relative movement of the body segments but also on the perception of this movement relative to the extrapersonal space.     

Elegant‐crested Tinamous Eudromia elegans do not synchronize head and leg movements during head‐bobbing

Head‐bobbing is the fore–aft movement of the head relative to the body during terrestrial locomotion in birds. It is considered to be a behaviour that helps to stabilize images on the retina during locomotion, yet some studies have suggested biomechanical links between the movements of the head and legs. This study analysed terrestrial locomotion and head‐bobbing in the Elegant‐crested Tinamou Eudromia elegans at a range of speeds by synchronously recording high‐speed video and ground reaction forces in a laboratory setting. The results indicate that the timing of head and leg movements are dissociated from one another. Nonetheless, head and neck movements do affect stance duration, ground reaction forces and body pitch and, as a result, the movement of the centre of mass in head‐bobbing birds. This study does not support the hypothesis that head‐bobbing is itself constrained by terrestrial locomotion. Instead, it suggests that visual cues are the primary trigger for head‐bobbing in birds, and locomotion is, in turn, constrained by a need for image stabilization and depth perception.     

Directional anisotropies reveal a functional segregation of visual motion processing for perception and action

Human exhibits an anisotropy in direction perception: discrimination is superior when motion is around horizontal or vertical rather than diagonal axes. In contrast to the consistent directional anisotropy in perception, we found only small idiosyncratic anisotropies in smooth pursuit eye movements, a motor action requiring accurate discrimination of visual motion direction. Both pursuit and perceptual direction discrimination rely on signals from the middle temporal visual area (MT), yet analysis of multiple measures of MT neuronal responses in the macaque failed to provide evidence of a directional anisotropy. We conclude that MT represents different motion directions uniformly, and subsequent processing creates a directional anisotropy in pathways unique to perception. Our data support the hypothesis that, at least for visual motion, perception and action are guided by inputs from separate sensory streams. The directional anisotropy of perception appears to originate after the two streams have segregated and downstream from area MT.