Cortical processing and perceived timing

As of yet, it is unclear how we determine relative perceived timing. One controversial suggestion is that timing perception might be related to when analyses are completed in the cortex of the brain. An alternate proposal suggests that perceived timing is instead related to the point in time at which cortical analyses commence. Accordingly, timing illusions should not occur owing to cortical analyses, but they could occur if there were differential delays between signals reaching cortex. Resolution of this controversy therefore requires that the contributions of cortical processing be isolated from the influence of subcortical activity. Here, we have done this by using binocular disparity changes, which are known to be detected via analyses that originate in cortex. We find that observers require longer stimulus exposures to detect small, relative to larger, disparity changes; observers are slower to react to smaller disparity changes and observers misperceive smaller disparity changes as being perceptually delayed. Interestingly, disparity magnitude influenced perceived timing more dramatically than it did stimulus change detection. Our data therefore suggest that perceived timing is both influenced by cortical processing and is shaped by sensory analyses subsequent to those that are minimally necessary for stimulus change perception.     

Probing depth in monocular images

It is generally expected that depth (distance) is the internal representational primitive that corresponds to much of the perception of 3D. We tested this assumption in monocular surface stimuli that are devoid of distance information (due to orthographic projection and the chosen surface shape, with perspective projection used as a control) and yet are vividly three-dimensional. Slant judgments were found to be in close correspondence with the actual geometric slant of the stimuli; the spatial orientation of the surfaces was perceived accurately. The apparent depth in these stimuli was then tested by superimposing a stereo depth probe over the monocular surface. In both the perspective and orthographic projection the gradient of perceived depth, measured by matching the apparent depth of the stereo probe with that of the monocular surface at a series of locations, was substantial. The experiments demonstrate that in orthographic projection the visual system can compute from local surface orientation a depth quantity that is commensurate with the relative depth derived from stereo disparity. The depth data suggests that, at least in the near field, the zero value for relative depth lies at the same absolute depth as the stereo horopter (locus of zero stereo disparity). Relative to this zero value, the depth-from-slant computation seems to provide an estimate of distance information that is independent of the absolute distance to the surface.Supproted by Office of Naval Research Contract N00014-K-84-0533. We gratefully acknowledge the suggestions of Jacob Beck regarding the experimental design, and the assistance provided by Cathryn Stanford     

Pre-attentive segmentation and correspondence in stereo

Traditional stereo grouping models have focused on the problem of stereo correspondence between monocular inputs. Recent physiological data revealed that the disparity selective V2 cells increase their responses when (random-dot stereograms) stimuli within their receptive fields are at or near the boundary of a depth surface. Such highlights to depth (non-luminance) edges are seemingly not computationally required for the correspondence problem. Computationally, these highlights make the boundaries of a depth surface more salient, serving pre-attentive segmentation (between depth planes) and attracting visual attention. In special cases, they enable the psychophysically observed perceptual pop-out of a target from a background of visually identical distractors at a different depth. To achieve the highlights, mutual inhibition between disparity selective cells that are tuned to the same or similar depths is required. However, such mutual inhibition would impede the computation for the correspondence problem, which requires mutual excitation between the same cells. In this work, I introduce a computational model that, I believe, is the first to address both stereo correspondence and pre-attentive stereo segmentation. The computational mechanisms in the model are based on intracortical interactions in V2. I will demonstrate that the model captures the following physiological and psychophysical phenomena: (i) depth-edge highlighting; (ii) disparity capture; (iii) pop-out; and (iv) transparency.     

Maximizing Sensory Dynamic Range by Tuning the Cortical State to Criticality

Modulation of interactions among neurons can manifest as dramatic changes in the state of population dynamics in cerebral cortex. How such transitions in cortical state impact the information processing performed by cortical circuits is not clear. Here we performed experiments and computational modeling to determine how somatosensory dynamic range depends on cortical state. We used microelectrode arrays to record ongoing and whisker stimulus-evoked population spiking activity in somatosensory cortex of urethane anesthetized rats. We observed a continuum of different cortical states; at one extreme population activity exhibited small scale variability and was weakly correlated, the other extreme had large scale fluctuations and strong correlations. In experiments, shifts along the continuum often occurred naturally, without direct manipulation. In addition, in both the experiment and the model we directly tuned the cortical state by manipulating inhibitory synaptic interactions. Our principal finding was that somatosensory dynamic range was maximized in a specific cortical state, called criticality, near the tipping point midway between the ends of the continuum. The optimal cortical state was uniquely characterized by scale-free ongoing population dynamics and moderate correlations, in line with theoretical predictions about criticality. However, to reproduce our experimental findings, we found that existing theory required modifications which account for activity-dependent depression. In conclusion, our experiments indicate that in vivo sensory dynamic range is maximized near criticality and our model revealed an unanticipated role for activity-dependent depression in this basic principle of cortical function.     

Predictive Coding or Evidence Accumulation? False Inference and Neuronal Fluctuations

Perceptual decisions can be made when sensory input affords an inference about what generated that input. Here, we report findings from two independent perceptual experiments conducted during functional magnetic resonance imaging (fMRI) with a sparse event-related design. The first experiment, in the visual modality, involved forced-choice discrimination of coherence in random dot kinematograms that contained either subliminal or periliminal motion coherence. The second experiment, in the auditory domain, involved free response detection of (non-semantic) near-threshold acoustic stimuli. We analysed fluctuations in ongoing neural activity, as indexed by fMRI, and found that neuronal activity in sensory areas (extrastriate visual and early auditory cortex) biases perceptual decisions towards correct inference and not towards a specific percept. Hits (detection of near-threshold stimuli) were preceded by significantly higher activity than both misses of identical stimuli or false alarms, in which percepts arise in the absence of appropriate sensory input. In accord with predictive coding models and the free-energy principle, this observation suggests that cortical activity in sensory brain areas reflects the precision of prediction errors and not just the sensory evidence or prediction errors per se.     

Effects of cortical damage on binocular depth perception

Stereoscopic depth perception requires considerable neural computation, including the initial correspondence of the two retinal images, comparison across the local regions of the visual field and integration with other cues to depth. The most common cause for loss of stereoscopic vision is amblyopia, in which one eye has failed to form an adequate input to the visual cortex, usually due to strabismus (deviating eye) or anisometropia. However, the significant cortical processing required to produce the percept of depth means that, even when the retinal input is intact from both eyes, brain damage or dysfunction can interfere with stereoscopic vision. In this review, I examine the evidence for impairment of binocular vision and depth perception that can result from insults to the brain, including both discrete damage, temporal lobectomy and more systemic diseases such as posterior cortical atrophy.This article is part of the themed issue ‘Vision in our three-dimensional world’.     

The N-terminal domain of the Agrobacterium tumefaciens telomere resolvase,TelA, regulates its DNA cleavage and rejoining activities

Linear replicons can be found in a minority of prokaryotic organisms, including Borrelia species and Agrobacterium tumefaciens. The problem with replicating the lagging strand end of linear DNAs is circumvented in these organisms by the presence of covalently closed DNA hairpin telomeres at the DNA termini. Telomere resolvases are enzymes responsible for generating these hairpin telomeres from a dimeric replication intermediate through a two-step DNA cleavage and rejoining reaction referred to as telomere resolution. It was previously shown that the agrobacterial telomere resolvase, TelA, possesses ssDNA annealing activity in addition to telomere resolution activity. The annealing activity derives, chiefly, from the N-terminal domain. This domain is dispensable for telomere resolution. In this study, we used activity analyses of an N-terminal domain deletion mutant, domain add back experiments, and protein–protein interaction studies and we report that the N-terminal domain of TelA is involved in inhibitory interactions with the remainder of TelA that are relieved by the binding of divalent metal ions. We also found that the regulation of telomere resolution by the N-terminal domain of TelA extends to suppression of inappropriate enzymatic activity, including hairpin telomere fusion (reaction reversal) and recombination between replicated telomeres to form a Holliday junction.     

Binocular coordination: reading stereoscopic sentences in depth

The present study employs a stereoscopic manipulation to present sentences in three dimensions to subjects as they read for comprehension. Subjects read sentences with (a) no depth cues, (b) a monocular depth cue that implied the sentence loomed out of the screen (i.e., increasing retinal size), (c) congruent monocular and binocular (retinal disparity) depth cues (i.e., both implied the sentence loomed out of the screen) and (d) incongruent monocular and binocular depth cues (i.e., the monocular cue implied the sentence loomed out of the screen and the binocular cue implied it receded behind the screen). Reading efficiency was mostly unaffected, suggesting that reading in three dimensions is similar to reading in two dimensions. Importantly, fixation disparity was driven by retinal disparity; fixations were significantly more crossed as readers progressed through the sentence in the congruent condition and significantly more uncrossed in the incongruent condition. We conclude that disparity depth cues are used on-line to drive binocular coordination during reading.     

Disparity estimation through Green’s functions of matching equations

Binocular disparities arise from positional differences of scene features projected in the two retinae, and constitute the primary sensory cue for stereo vision. Here we introduce a new computational model for disparity estimation, based on the Green’s function of an image matching equation. When filtering a Gabor-function-modulated signal, the considered Green’s function yields a similarly modulated but shifted version of the original signal. Since a Gabor function models the receptive field of a cortical simple cell, the Green’s kernel thus allows the simulation of relative shifts between the cell’s left and right binocular inputs. A measure of the local degree of matching of such shifted inputs can then be introduced which affords disparity estimation in a similar manner to the energy model of the complex cortical cells. We have therefore effectively reformulated, in physiologically plausible terms, an image matching approach to disparity estimation. Our experiments show that the Green’s function method allows the detection of disparities both from random-dot and real-world stereograms. Partially supported by CNPq-Brazil.     

A Bayesian model of stereopsis depth and motion direction discrimination

 The extraction of stereoscopic depth from retinal disparity, and motion direction from two-frame kinematograms, requires the solution of a correspondence problem. In previous psychophysical work [Read and Eagle (2000) Vision Res 40: 3345–3358], we compared the performance of the human stereopsis and motion systems with correlated and anti-correlated stimuli. We found that, although the two systems performed similarly for narrow-band stimuli, broad-band anti-correlated kinematograms produced a strong perception of reversed motion, whereas the stereograms appeared merely rivalrous. I now model these psychophysical data with a computational model of the correspondence problem based on the known properties of visual cortical cells. Noisy retinal images are filtered through a set of Fourier channels tuned to different spatial frequencies and orientations. Within each channel, a Bayesian analysis incorporating a prior preference for small disparities is used to assess the probability of each possible match. Finally, information from the different channels is combined to arrive at a judgement of stimulus disparity. Each model system – stereopsis and motion – has two free parameters: the amount of noise they are subject to, and the strength of their preference for small disparities. By adjusting these parameters independently for each system, qualitative matches are produced to psychophysical data, for both correlated and anti-correlated stimuli, across a range of spatial frequency and orientation bandwidths. The motion model is found to require much higher noise levels and a weaker preference for small disparities. This makes the motion model more tolerant of poor-quality reverse-direction false matches encountered with anti-correlated stimuli, matching the strong perception of reversed motion that humans experience with these stimuli. In contrast, the lower noise level and tighter prior preference used with the stereopsis model means that it performs close to chance with anti-correlated stimuli, in accordance with human psychophysics. Thus, the key features of the experimental data can be reproduced assuming that the motion system experiences more effective noise than the stereoscopy system and imposes a less stringent preference for small disparities. Received: 2 March 2001 / Accepted in revised form: 5 July 2001     

Specificity and Plasticity of Thalamocortical Connections in Sema6A Mutant Mice

The establishment of connectivity between specific thalamic nuclei and cortical areas involves a dynamic interplay between the guidance of thalamocortical axons and the elaboration of cortical areas in response to appropriate innervation. We show here that Sema6A mutants provide a unique model to test current ideas on the interactions between subcortical and cortical guidance mechanisms and cortical regionalization. In these mutants, axons from the dorsal lateral geniculate nucleus (dLGN) are misrouted in the ventral telencephalon. This leads to invasion of presumptive visual cortex by somatosensory thalamic axons at embryonic stages. Remarkably, the misrouted dLGN axons are able to find their way to the visual cortex via alternate routes at postnatal stages and reestablish a normal pattern of thalamocortical connectivity. These findings emphasize the importance and specificity of cortical cues in establishing thalamocortical connectivity and the spectacular capacity of the early postnatal cortex for remapping initial sensory representations.     

The direction of retinal motion facilitates binocular stereopsis.

Visual information from binocular disparity and from relative motion provide information about three-dimensional structure and layout of the world. Although the mechanisms that process these cues have typically been studied independently, there is now a substantial body of evidence that suggests that they interact in the visual pathway. This paper investigates one advantage of such an interaction: whether retinal motion can be used as a matching constraint in the binocular correspondence process. Stimuli that contained identical disparity and motion signals but which differed in their fine-scale correlation were created to establish whether the direction, or the speed, of motion could enhance performance in a psychophysical task in which binocular matching is a limiting factor. The results of these experiments provide clear evidence that different directions of motion, but not different speeds, are processed separately in stereopsis. The results fit well with properties of neurons early in the cortical visual pathway which are thought to be involved in determining local matches between features in the two eyes'' images.     

Brain damage and global stereopsis.

When a single object lies in front of or beyond the plane of fixation its retinal image lies on disparate positions in the two eyes. This 'local' retinal disparity is an excellent cue to depth, and retinal disparties of a few seconds of arc are detectable by people and monkeys. However, most visual scenes produce a complex array of contours in each eye and we can detect the disparity in the arrays despite the ambiguous nature of the disparities, i.e. each contour in one eye could be related to any of several similar contours in the other eye. This ability, known as 'global' stereopsis, may be selectively impaired following brain damage in man. Global stereopsis was measured in rhesus monkeys before and after removing a different cortical visual area in different groups of animals. Only removal of the inferotemporal cortex impaired global stereopsis. The result is related to the findings with human patients and to receptive field properties of neurons in the inferotemporal cortex of monkeys.     

Functional Roles of 10 Hz Alpha-Band Power Modulating Engagement and Disengagement of Cortical Networks in a Complex Visual Motion Task

Alpha band power, particularly at the 10 Hz frequency, is significantly involved in sensory inhibition, attention modulation, and working memory. However, the interactions between cortical areas and their relationship to the different functional roles of the alpha band oscillations are still poorly understood. Here we examined alpha band power and the cortico-cortical interregional phase synchrony in a psychophysical task involving the detection of an object moving in depth by an observer in forward self-motion. Wavelet filtering at the 10 Hz frequency revealed differences in the profile of cortical activation in the visual processing regions (occipital and parietal lobes) and in the frontoparietal regions. The alpha rhythm driving the visual processing areas was found to be asynchronous with the frontoparietal regions. These findings suggest a decoupling of the 10 Hz frequency into separate functional roles: sensory inhibition in the visual processing regions and spatial attention in the frontoparietal regions.     

Learning cortical topography from spatiotemporal stimuli

Stimulus representation is a functional interpretation of early sensory cortices. Early sensory cortices are subject to stimulus-induced modifications. Common models for stimulus-induced learning within topographic representations are based on the stimuli's spatial structure and probability distribution. Furthermore, we argue that average temporal stimulus distances reflect the stimuli's relatedness. As topographic representations reflect the stimuli's relatedness, the temporal structure of incoming stimuli is important for the learning in cortical maps. Motivated by recent neurobiological findings, we present an approach of cortical self-organization that additionally takes temporal stimulus aspects into account. The proposed model transforms average interstimulus intervals into representational distances. Thereby, neural topography is related to stimulus dynamics. This offers a new time-based interpretation of cortical maps. Our approach is based on a wave-like spread of cortical activity. Interactions between dynamics and feedforward activations lead to shifts of neural activity. The psychophysical saltation phenomenon may represent an analogue to the shifts proposed here. With regard to cortical plasticity, we offer an explanation for neurobiological findings that other models cannot explain. Moreover, we predict cortical reorganizations under new experimental, spatiotemporal conditions. With regard to psychophysics, we relate the saltation phenomenon to dynamics and interaction in early sensory cortices and predict further effects in the perception of spatiotemporal stimuli. Received: 17 March 1999 / Accepted in revised form: 10 August 1999     

Visual Sensorial Impairments in Neurodevelopmental Disorders: Evidence for a Retinal Phenotype in Fragile X Syndrome

Visual sensory impairments are common in Mental Deficiency (MD) and Autism Spectrum Disorder (ASD). These defects are linked to cerebral dysfunction in the visual cortical area characterized by the deregulation of axon growth/guidance and dendrite spine immaturity of neurons. However, visual perception had not been addressed, although the retina is part of the central nervous system with a common embryonic origin. Therefore, we investigated retinal perception, the first event of vision, in a murine model of MD with autistic features. We document that retinal function is altered in Fmr1 KO mice, a model of human Fragile X Syndrome. Indeed, In Fmr1 KO mice had a lower retinal function characterized by a decreased photoreceptors neuron response, due to a 40% decrease in Rhodopsin content and to Rod Outer Segment destabilization. In addition, we observed an alteration of the visual signal transmission between photoreceptors and the inner retina which could be attributed to deregulations of pre- and post- synaptic proteins resulting in retinal neurons synaptic destabilization and to retinal neurons immaturity. Thus, for the first time, we demonstrated that retinal perception is altered in a murine model of MD with autistic features and that there are strong similarities between cerebral and retinal cellular and molecular defects. Our results suggest that both visual perception and integration must be taken into account in assessing visual sensory impairments in MD and ASD.     

Mouse embryonic retina delivers information controlling cortical neurogenesis

The relative contribution of extrinsic and intrinsic mechanisms to cortical development is an intensely debated issue and an outstanding question in neurobiology. Currently, the emerging view is that interplay between intrinsic genetic mechanisms and extrinsic information shape different stages of cortical development. Yet, whereas the intrinsic program of early neocortical developmental events has been at least in part decoded, the exact nature and impact of extrinsic signaling are still elusive and controversial. We found that in the mouse developing visual system, acute pharmacological inhibition of spontaneous retinal activity (retinal waves-RWs) during embryonic stages increase the rate of corticogenesis (cell cycle withdrawal). Furthermore, early perturbation of retinal spontaneous activity leads to changes of cortical layer structure at a later time point. These data suggest that mouse embryonic retina delivers long-distance information capable of modulating cell genesis in the developing visual cortex and that spontaneous activity is the candidate long-distance acting extrinsic cue mediating this process. In addition, these data may support spontaneous activity to be a general signal coordinating neurogenesis in other developing sensory pathways or areas of the central nervous system.     

Where Do the Eyes Really Go in the Hollow-Face Illusion?

The hollow-face illusion refers to the finding that people typically perceive a concave (hollow) mask as being convex, despite the presence of binocular disparity cues that indicate the contrary. Unlike other illusions of depth, recent research has suggested that the eyes tend to converge at perceived, rather than actual, depths. However, technical and methodological limitations prevented one from knowing whether disparity cues may still have influenced vergence. In the current study, we presented participants with virtual normal or hollow masks and asked them to fixate the tip of the face's nose until they had indicated whether they perceived it as pointing towards or away from them. The results showed that the direction of vergence was indeed determined by perceived depth, although vergence responses were both somewhat delayed and of smaller amplitude (by a factor of about 0.5) for concave than convex masks. These findings demonstrate how perceived depth can override disparity cues when it comes to vergence, albeit not entirely.