Visual contributions to human self-motion perception during horizontal body rotation

It is still an enigma how human subjects combine visual and vestibular inputs for their self-motion perception. Visual cues have the benefit of high spatial resolution but entail the danger of self motion illusions. We performed psychophysical experiments (verbal estimates as well as pointer indications of perceived self-motion in space) in normal subjects (Ns) and patients with loss of vestibular function (Ps). Subjects were presented with horizontal sinusoidal rotations of an optokinetic pattern (OKP) alone (visual stimulus; 0.025-3.2 Hz; displacement amplitude, 8 degrees) or in combinations with rotations of a Bárány chair (vestibular stimulus; 0.025-0.4 Hz; +/- 8 degrees). We found that specific instructions to the subjects created different perceptual states in which their self-motion perception essentially reflected three processing steps during pure visual stimulation: i) When Ns were primed by a procedure based on induced motion and then they estimated perceived self-rotation upon pure optokinetic stimulation (circular vection, CV), the CV has a gain close to unity up to frequencies of almost 0.8 Hz, followed by a sharp decrease at higher frequencies (i.e., characteristics resembling those of the optokinetic reflex, OKR, and of smooth pursuit, SP). ii) When Ns were instructed to "stare through" the optokinetic pattern, CV was absent at high frequency, but increasingly developed as frequency was decreased below 0.1 Hz. iii) When Ns "looked at" the optokinetic pattern (accurately tracked it with their eyes) CV was usually absent, even at low frequency. CV in Ps showed similar dynamics as in Ns in condition i), independently of the instruction. During vestibular stimulation, self-motion perception in Ns fell from a maximum at 0.4 Hz to zero at 0.025 Hz. When vestibular stimulation was combined with visual stimulation while Ns "stared through" OKP, perception at low frequencies became modulated in magnitude. When Ns "looked" at OKP, this modulation was reduced, apart from the synergistic stimulus combination (OKP stationary) where magnitude was similar as during "staring". The obtained gain and phase curves of the perception were incompatible with linear systems prediction. We therefore describe the present findings by a non-linear dynamic model in which the visual input is processed in three steps: i) It shows dynamics similar to those of OKR and SP; ii) it is shaped to complement the vestibular dynamics and is fused with a vestibular signal by linear summation; and iii) it can be suppressed by a visual-vestibular conflict mechanism when the visual scene is moving in space. Finally, an important element of the model is a velocity threshold of about 1.2 degrees/s which is instrumental in maintaining perceptual stability and in explaining the observed dynamics of perception. We conclude from the experimental and theoretical evidence that self-motion perception normally is related to the visual scene as a reference, while the vestibular input is used to check the kinematic state of the scene; if the scene appears to move, the visual signal becomes suppressed and perception is based on the vestibular cue.     

Feedback contributions to visual awareness in human occipital cortex

It has traditionally been assumed that processing within the visual system proceeds in a bottom-up, feedforward manner from retina to higher cortical areas. In addition to feedforward processing, it is now clear that there are also important contributions to sensory encoding that rely upon top-down, feedback (reentrant) projections from higher visual areas to lower ones. By utilizing transcranial magnetic stimulation (TMS) in a metacontrast masking paradigm, we addressed whether feedback processes in early visual cortex play a role in visual awareness. We show that TMS of visual cortex, when timed to produce visual suppression of an annulus serving as a metacontrast mask, induces recovery of an otherwise imperceptible disk. In addition to producing disk recovery, TMS suppression of an annulus was greater when a disk preceded it than when an annulus was presented alone. This latter result suggests that there are effects of the disk on the perceptibility of the subsequent mask that are additive and are revealed with TMS of the visual cortex. These results demonstrate spatial and temporal interactions of conscious vision in visual cortex and suggest that a prior visual stimulus can influence subsequent perception at early stages of visual encoding via feedback projections.     

Sounds reset rhythms of visual cortex and corresponding human visual perception

An event in one sensory modality can phase reset brain oscillations concerning another modality. In principle, this may result in stimulus-locked periodicity in behavioral performance. Here we considered this possible cross-modal impact of a sound for one of the best-characterized rhythms arising from the visual system, namely occipital alpha-oscillations (8-14 Hz). We presented brief sounds and concurrently recorded electroencephalography (EEG) and/or probed visual cortex excitability (phosphene perception) through occipital transcranial magnetic stimulation (TMS). In a first, TMS-only experiment, phosphene perception rate against time postsound showed a periodic pattern cycling at ~10 Hz phase-aligned to the sound. In a second, combined TMS-EEG experiment, TMS-trials reproduced the cyclical phosphene pattern and revealed a ~10 Hz pattern also for EEG-derived measures of occipital cortex reactivity to the TMS pulses. Crucially, EEG-data from intermingled trials without TMS established cross-modal phase-locking of occipitoparietal alpha oscillations. These independently recorded variables, i.e., occipital cortex excitability and reactivity and EEG phase dynamics, were significantly correlated. This shows that cross-modal phase locking of oscillatory visual cortex activity can arise in the human brain to affect perceptual and EEG measures of visual processing in a cyclical manner, consistent with occipital alpha oscillations underlying a rapid cycling of neural excitability in visual areas.     

Linking visual perception with human brain activity.

The past year has seen great advances in the use of functional magnetic resonance imaging (fMRI) to study the functional organization of the human visual cortex, to measure the neuronal correlates of visual perception, and to test computational theories of vision. Activity in particular visual brain areas, as measured with fMRI, has been found to correlate with psychophysical performance, with visual attention, and with subjective perceptual experience.     

Music alters visual perception

Background

Visual perception is not a passive process: in order to efficiently process visual input, the brain actively uses previous knowledge (e.g., memory) and expectations about what the world should look like. However, perception is not only influenced by previous knowledge. Especially the perception of emotional stimuli is influenced by the emotional state of the observer. In other words, how we perceive the world does not only depend on what we know of the world, but also by how we feel. In this study, we further investigated the relation between mood and perception.

Methods and Findings

We let observers do a difficult stimulus detection task, in which they had to detect schematic happy and sad faces embedded in noise. Mood was manipulated by means of music. We found that observers were more accurate in detecting faces congruent with their mood, corroborating earlier research. However, in trials in which no actual face was presented, observers made a significant number of false alarms. The content of these false alarms, or illusory percepts, was strongly influenced by the observers'' mood.

Conclusions

As illusory percepts are believed to reflect the content of internal representations that are employed by the brain during top-down processing of visual input, we conclude that top-down modulation of visual processing is not purely predictive in nature: mood, in this case manipulated by music, may also directly alter the way we perceive the world.     

Camouflage and visual perception

How does an animal conceal itself from visual detection by other animals? This review paper seeks to identify general principles that may apply in this broad area. It considers mechanisms of visual encoding, of grouping and object encoding, and of search. In most cases, the evidence base comes from studies of humans or species whose vision approximates to that of humans. The effort is hampered by a relatively sparse literature on visual function in natural environments and with complex foraging tasks. However, some general constraints emerge as being potentially powerful principles in understanding concealment—a ‘constraint’ here means a set of simplifying assumptions. Strategies that disrupt the unambiguous encoding of discontinuities of intensity (edges), and of other key visual attributes, such as motion, are key here. Similar strategies may also defeat grouping and object-encoding mechanisms. Finally, the paper considers how we may understand the processes of search for complex targets in complex scenes. The aim is to provide a number of pointers towards issues, which may be of assistance in understanding camouflage and concealment, particularly with reference to how visual systems can detect the shape of complex, concealed objects.     

Further contributions to the mathematical biophysics of visual aesthetics

In previous papers cases were considered in which a visual pattern consists of a relatively small number of relatively strongly excited elements. Those cases are of interest in the theory of visual perception and aesthetic rating of artificial man made patterns. By an extension of the theory so as to take into account the finite thresholds of the inhibiting fibers a theory of aesthetic ratings of pattern consisting of a very large number of elements is outlined. This type of theory is applicable to natural patterns, such as landscapes.     

Visual perception: understanding visual cues to depth

A new study shows that, in vision, object blur can be a more accurate depth cue than stereo disparity.     

Attention and visual perception

Somewhere between the retina and our conscious visual experience, the majority of the information impinging on the eye is lost. We are typically aware of only either the most salient parts of a visual scene or the parts that we are actively paying attention to. Recent research on visual neurons in monkeys is beginning to show how the brain both selects and discards incoming visual information. For example, what happens to the responses of visual neurons when attention is directed to one element, such as an oriented colored bar, embedded among an array of other oriented bars? Some of this research shows that attention to the oriented bar restricts the receptive field of visual neurons down to this single element. However, other research shows that attention to this single element affects the responses of neurons with receptive fields throughout the visual field. In this review, these two seemingly contradictory results are shown to actually be mutually consistent. A simple computational model is described that explains these results, and also provides a framework for predicting a variety of additional neurophysiological, neuroimaging and behavioral studies of attention.     

Melanopsin contributions to irradiance coding in the thalamo-cortical visual system

Photoreception in the mammalian retina is not restricted to rods and cones but extends to a subset of retinal ganglion cells expressing the photopigment melanopsin (mRGCs). These mRGCs are known to drive such reflex light responses as circadian photoentrainment and pupillomotor movements. By contrast, until now there has been no direct assessment of their contribution to conventional visual pathways. Here, we address this deficit. Using new reporter lines, we show that mRGC projections are much more extensive than previously thought and extend across the dorsal lateral geniculate nucleus (dLGN), origin of thalamo-cortical projection neurons. We continue to show that this input supports extensive physiological light responses in the dLGN and visual cortex in mice lacking rods+cones (a model of advanced retinal degeneration). Moreover, using chromatic stimuli to isolate melanopsin-derived responses in mice with an intact visual system, we reveal strong melanopsin input to the ～40% of neurons in the LGN that show sustained activation to a light step. We demonstrate that this melanopsin input supports irradiance-dependent increases in the firing rate of these neurons. The implication that melanopsin is required to accurately encode stimulus irradiance is confirmed using melanopsin knockout mice. Our data establish melanopsin-based photoreception as a significant source of sensory input to the thalamo-cortical visual system, providing unique irradiance information and allowing visual responses to be retained even in the absence of rods+cones. These findings identify mRGCs as a potential origin for aspects of visual perception and indicate that they may support vision in people suffering retinal degeneration.     

Learning to use an invisible visual signal for perception

How does the brain construct a percept from sensory signals? One approach to this fundamental question is to investigate perceptual learning as induced by exposure to statistical regularities in sensory signals [1-7]. Recent studies showed that exposure to novel correlations between sensory signals can cause a signal to have new perceptual effects [2, 3]. In those studies, however, the signals were clearly visible. The automaticity of the learning was therefore difficult to determine. Here we investigate whether learning of this sort, which causes new effects on appearance, can be low level and automatic by employing a visual signal whose perceptual consequences were made invisible-a vertical disparity gradient masked by other depth cues. This approach excluded high-level influences such as attention or consciousness. Our stimulus for probing perceptual appearance was a rotating cylinder. During exposure, we introduced a new contingency between the invisible signal and the rotation direction of the cylinder. When subsequently presenting an ambiguously rotating version of the cylinder, we found that the invisible signal influenced the perceived rotation direction. This demonstrates that perception can rapidly undergo "structure learning" by automatically picking up novel contingencies between sensory signals, thus automatically recruiting signals for novel uses during the construction of a percept.     

A comparative psychophysical approach to visual perception in primates

Studies on the visual processing of primates, which have well developed visual systems, provide essential information about the perceptual bases of their higher-order cognitive abilities. Although the mechanisms underlying visual processing are largely shared between human and nonhuman primates, differences have also been reported. In this article, we review psychophysical investigations comparing the basic visual processing that operates in human and nonhuman species, and discuss the future contributions potentially deriving from such comparative psychophysical approaches to primate minds.     

Mathematical model of visual perception

A mathematical model of visual perception is presented with the intention of throwing some light on the problem of perceptual invariance. Two types of differential manifolds (receptive and effector) are associated with the repertoire which is the fundamental concept in the model. The elements of the repertoire carry weights which control the input-output relation in the repertoire and which can be modified by a learning process. It is shown that, under reasonable conditions, these repertoires possess good stability properties and can adjust to the various environments to which they may be subjected. In particular cases, it is shown that the stochastic learning process can be considered as deterministic to a first approximation.     

Internal models for visual perception

 Although the extrapolation of past perceptual history into the immediate and distant future is a fundamental phenomenon in everyday life, the underlying processing mechanisms are not well understood. A network model consisting of interacting excitatory and inhibitory cell populations coding for stimulus position is used to study the neuronal population response to a continuously moving stimulus. An adaptation mechanism is proposed that offers the possibility to control and modulate motion-induced extrapolation without changing the spatial interaction structure within the network. Using an occluder paradigm, functional advantages of an internally generated model of a moving stimulus are discussed. It is shown that the integration of such a model in processing leads to a faster and more reliable recognition of the input stream and allows for object permanence following occlusion. The modeling results are discussed in relation to recent experimental findings that show motion-induced extrapolation. Received: 19 December 2001 / Accepted: 26 November 2002 / Published online: 3 April 2003 Correspondence to: W. Erlhagen (e-mail: wolfram.erlhagen@mct.uminho.pt) Acknowledgements. The author would like to thank D. Jancke for useful discussions and two anonymous reviewers for helpful comments and suggestions on a previous version of this paper. This research was supported by a European grant (IST-2000-29689) and by the Portuguese Science Foundation (POSI/SRI/38051/2001).     

The physics of visual perception

By measuring the contrast threshold for gratings of different waveform and spatial frequency, Campbell & Robson suggested in 1968 that there may be 'channels' tuned to different spatial frequencies. By using the technique of adapting to a high contrast grating, it was possible to measure the band-pass characteristics of these channels. Similar techniques were used to establish the orientational tuning of the channels. Reasons are put forward why it is advantageous to organize the visual system in this manner.     

A model of visual perception

In this paper we propose a model of visual perception in which a positive feedback mechanism can reproduce the pattern stimulus on a neurons screen. The pattern stimulus reproduction is based on informations coming from the spatial derivatives of visual pattern. This information together with the response of the feature extractors provides to the reproduction of the visual pattern as neuron screen electric activity. We simulate several input patterns and prove that the model reproduces the percept.