On the sufficiency of the velocity field for perception of heading

All models of self-motion from optical flow assume the instantaneous velocity field as input. We tested this assumption for human observers using random-dot displays that simulated translational and circular paths of movement by manipulating the lifetime and displacement of individual dots. For translational movement, observers were equally accurate in judging direction of heading from a velocity field with a two-frame dot life and a direction field in which the magnitudes of displacement were randomized while the radial pattern of directions was preserved, but at chance with a speed field in which the directions were randomized, preserving only magnitude. Accuracy declined with increasing noise in vector directions, but remained below 2.6° with a 90° noise envelope. Thus, the visual system uses the radial morphology of vector directions to determine translational heading and can tolerate large amounts of noise in this pattern. For circular movement, observers were equally accurate with a 2-frame velocity field, 3-frame acceleration displays, and 2-frame and 3-frame direction fields, consistent with the use of the pattern of vector directions to locate the center of rotation. The results indicate that successive independent velocity fields are sufficient for perception of translational and circular heading.     

Interaction of retinal image and eye velocity in motion perception

When we move our eyes, why does the world look stable even as its image flows across our retinas, and why do afterimages, which are stationary on the retinas, appear to move? Current theories say this is because we perceive motion by summation: if an object slips across the retina at r degrees/s while the eye turns at e degrees/s, the object's perceived velocity in space should be r + e. We show that activity in MT+, the visual-motion complex in human cortex, does reflect a mix of r and e rather than r alone. But we show also that, for optimal perception, r and e should not summate; rather, the signals coding e interact multiplicatively with the spatial gradient of illumination.     

Separate visual representations for perception and action revealed by saccadic eye movements

Some 30 years ago, Trevarthen [1] introduced the idea of two separate visual systems, a focal system for fine motor acts and an ambient system for gross body movements such as ambulation. More recent developments indicating anatomically and physiologically separate pathways in primate vision [2] have led to a different idea of separate visual systems, one for conscious perception and one for action [3]. It has received empirical support from several studies showing that pointing, reaching, and grasping can remain accurate while the perceived position or size of objects is subject to illusory distortion [4-6]. However, much of this evidence has been challenged on the grounds of methodological flaws, particularly failure to match perfectly the conditions for verbal and motor tasks and failure to replicate results [7-10]. Here we take advantage of the strong compression of perceived position that occurs around the time of saccadic eye movements [11, 12]. Under normal lighting conditions, stimuli flashed briefly over a wide range of spatial positions just before saccadic onset are neither seen nor reached for in their veridical positions, but are compressed toward the saccadic target. We validate the idea of separate systems by showing that, in the dark, subjects are able to point accurately to the correct target position, even though their verbal reports are still subject to compression.     

Acceleration and velocity signals trigger otolithic eye movements during lateral translation

Since it is still controversial what kinds of driving signals are effective in otolith [correction of otholith] ocular responses, we attempted to compare eye movement responses between the step and sinusoidal modes of lateral translation.     

Coevolution of visual signals and eye morphology in Polistes paper wasps

To be effective, signals must propagate through the environment and be detected by receivers. As a result, signal form evolves in response to both the constraints imposed by the transmission environment and receiver perceptual abilities. Little work has examined the extent to which signals may act as selective forces on receiver sensory systems to improve the efficacy of communication. If receivers benefit from accurate signal assessment, selection could favour sensory organs that improve discrimination of established signals. Here, we provide evidence that visual resolution coevolves with visual signals in Polistes wasps. Multiple Polistes species have variable facial patterns that function as social signals, whereas other species lack visual signals. Analysis of 19 Polistes species shows that maximum eye facet size is positively associated with both eye size and presence of visual signals. Relatively larger facets within the eye''s acute zone improve resolution of small images, such as wasp facial signals. Therefore, sensory systems may evolve to optimize signal assessment. Sensory adaptations to facilitate signal detection may represent an overlooked area of the evolution of animal communication.     

The physics of visual perception

By measuring the contrast threshold for gratings of different waveform and spatial frequency, Campbell & Robson suggested in 1968 that there may be 'channels' tuned to different spatial frequencies. By using the technique of adapting to a high contrast grating, it was possible to measure the band-pass characteristics of these channels. Similar techniques were used to establish the orientational tuning of the channels. Reasons are put forward why it is advantageous to organize the visual system in this manner.     

The nose smells what the eye sees: crossmodal visual facilitation of human olfactory perception

Human olfactory perception is notoriously unreliable, but shows substantial benefits from visual cues, suggesting important crossmodal integration between these primary sensory modalities. We used event-related fMRI to determine the underlying neural mechanisms of olfactory-visual integration in the human brain. Subjects participated in an olfactory detection task, whereby odors and pictures were delivered separately or together. By manipulating the degree of semantic correspondence between odor-picture pairs, we show a perceptual olfactory facilitation for semantically congruent (versus incongruent) trials. This behavioral advantage was associated with enhanced neural activity in anterior hippocampus and rostromedial orbitofrontal cortex. We suggest these findings can be interpreted as indicating that human hippocampus mediates reactivation of crossmodal semantic associations, even in the absence of explicit memory processing.     

Correlations between the fMRI BOLD signal and visual perception

Using fMRI and a psychophysical task involving letter identification, Kleinschmidt et al. (2002) (this issue of Neuron) delineate two patterns of neural activation, which manifest in different cortical regions: a transient activation, correlated with the change of a percept, and a longer-term hysteresis, correlated with the maintenance of the percept. These findings are provocative and suggest that neural hysteresis is mediated by visual structures that interact with higher-order regions to support longer-term maintenance of a percept.     

The directional flow of visual information transfer between pedestrians

Close behavioural coupling of visual orientation may provide a range of adaptive benefits to social species. In order to investigate the natural properties of gaze-following between pedestrians, we displayed an attractive stimulus in a frequently trafficked corridor within which a hidden camera was placed to detect directed gaze from passers-by. The presence of visual cues towards the stimulus by nearby pedestrians increased the probability of passers-by looking as well. In contrast to cueing paradigms used for laboratory research, however, we found that individuals were more responsive to changes in the visual orientation of those walking in the same direction in front of them (i.e. viewing head direction from behind). In fact, visual attention towards the stimulus diminished when oncoming pedestrians had previously looked. Information was therefore transferred more effectively behind, rather than in front of, gaze cues. Further analyses show that neither crowding nor group interactions were driving these effects, suggesting that, within natural settings gaze-following is strongly mediated by social interaction and facilitates acquisition of environmentally relevant information.     

The perception of visual motion.

Recent developments have led to a greater insight into the complex processes of perception of visual motion. A better understanding of the neuronal circuitry involved and advances in electrophysiological techniques have allowed researchers to alter the perception of an animal with a stimulating electrode. In addition, studies have further elucidated the processes by which signals are combined and compared, allowing a greater understanding of the effects of selective brain damage.     

Mutual dependencies between vocal and visual signals of squirrel monkeys

Visually recognizable social signals and structural call components, which had been demonstrated to be of social relevance within their own communication channel in previous experiments (disregarding or experimentally excluding other ones), were treated together, and their inter-dependencies analyzed when they were performed simultaneously in spontaneous behavior sequences of pairs of adult squirrel monkeys. It was found that: (1) all call classes were uttered within periods when either genital display or “triumph gesture” were shown; (2) production rates of particular vocal classes significantly deviated from no-display periods; (3) degree and direction of deviations (more/less frequent) were quite specific for both vocal and nonvocal classes (Figs. 1a & 1b); (4) differences depended also on which animal actually displayed (the vocalizing one, the other one, or both; Fig. 3); and (5) differences found for single animals when they played different roles in the experimental situation were smaller than those found between individuals, which could be related to dominance status (Table 2). The possibility of mutual modification of signals of different modalities and perspectives for future work are discussed.     

The ecology and evolution of visual pollen signals

By offering pollen and/or nectar as a food resource, angiosperms exploit flower visitors for pollen transport. Pollen thus acts not only as a means for transportation of male gametes, but also as a food reward for potential pollinators. Many findings provide compelling evidence that pollen acts, in addition, as a visual signal. The present contribution reviews several strategies that angiosperms have evolved to attract potential pollinators to the site of reward. We here consider evolutionary, ecological, sensory-physiological, and behavioural aspects of flower-pollinator interactions that are correlated with visual signals provided by pollen and pollen-producing organs, or imitations thereof.     

The neural basis of visual body perception

The human body, like the human face, is a rich source of socially relevant information about other individuals. Evidence from studies of both humans and non-human primates points to focal regions of the higher-level visual cortex that are specialized for the visual perception of the body. These body-selective regions, which can be dissociated from regions involved in face perception, have been implicated in the perception of the self and the 'body schema', the perception of others' emotions and the understanding of actions.