Reduced Crowding and Poor Contour Detection in Schizophrenia Are Consistent with Weak Surround Inhibition

Background

Detection of visual contours (strings of small oriented elements) is markedly poor in schizophrenia. This has previously been attributed to an inability to group local information across space into a global percept. Here, we show that this failure actually originates from a combination of poor encoding of local orientation and abnormal processing of visual context.

Methods

We measured the ability of observers with schizophrenia to localise contours embedded in backgrounds of differently oriented elements (either randomly oriented, near-parallel or near-perpendicular to the contour). In addition, we measured patients’ ability to process local orientation information (i.e., report the orientation of an individual element) for both isolated and crowded elements (i.e., presented with nearby distractors).

Results

While patients are poor at detecting contours amongst randomly oriented elements, they are proportionally less disrupted (compared to unaffected controls) when contour and surrounding elements have similar orientations (near-parallel condition). In addition, patients are poor at reporting the orientation of an individual element but, again, are less prone to interference from nearby distractors, a phenomenon known as visual crowding.

Conclusions

We suggest that patients’ poor performance at contour perception arises not as a consequence of an “integration deficit” but from a combination of reduced sensitivity to local orientation and abnormalities in contextual processing. We propose that this is a consequence of abnormal gain control, a phenomenon that has been implicated in orientation-selectivity as well as surround suppression.     

Top-down modulation of lateral interactions in early vision: does attention affect integration of the whole or just perception of the parts?

Attention can modulate sensitivity to local stimuli in early vision. But, can attention also modulate integration of local stimuli into global visual patterns? We recently measured effects of attention on the phenomenon of lateral interactions between collinear elements, commonly thought to reflect long-range mechanisms in early visual cortex underlying contour integration. We showed improved detection of low-contrast central Gabor targets in the context of collinear flankers, but only when the collinear flankers were attended for a secondary task rather than ignored in favor of an orthogonal flanker pair. Here, we contrast two hypotheses for how attention might modulate flanker influences on the target: by changing just local sensitivity to the flankers themselves (flanker-modulation-only hypothesis), or by weighting integrative connections between flanker and target (connection-weighting hypothesis). Modeled on the known nonlinear dependence of target visibility on collinear flanker contrast, the first hypothesis predicts that an increase in physical flanker contrast should readily offset any reduction in their effective contrast when ignored, thus eliminating attentional modulation. Conversely, the second hypothesis predicts that attentional modulation should persist even for the highest flanker contrasts. Our results showed the latter outcome and indicated that attention modulates flanker-target integration, rather than just processing of local flanker elements.     

Perceptual organization of local elements into global shapes in the human visual cortex

The question of how local image features on the retina are integrated into perceived global shapes is central to our understanding of human visual perception. Psychophysical investigations have suggested that the emergence of a coherent visual percept, or a "good-Gestalt", is mediated by the perceptual organization of local features based on their similarity. However, the neural mechanisms that mediate unified shape perception in the human brain remain largely unknown. Using human fMRI, we demonstrate that not only higher occipitotemporal but also early retinotopic areas are involved in the perceptual organization and detection of global shapes. Specifically, these areas showed stronger fMRI responses to global contours consisting of collinear elements than to patterns of randomly oriented local elements. More importantly, decreased detection performance and fMRI activations were observed when misalignment of the contour elements disturbed the perceptual coherence of the contours. However, grouping of the misaligned contour elements by disparity resulted in increased performance and fMRI activations, suggesting that similar neural mechanisms may underlie grouping of local elements to global shapes by different visual features (orientation or disparity). Thus, these findings provide novel evidence for the role of both early feature integration processes and higher stages of visual analysis in coherent visual perception.     

Local and Global Limits on Visual Processing in Schizophrenia

Schizophrenia has been linked to impaired performance on a range of visual processing tasks (e.g. detection of coherent motion and contour detection). It has been proposed that this is due to a general inability to integrate visual information at a global level. To test this theory, we assessed the performance of people with schizophrenia on a battery of tasks designed to probe voluntary averaging in different visual domains. Twenty-three outpatients with schizophrenia (mean age: 40±8 years; 3 female) and 20 age-matched control participants (mean age 39±9 years; 3 female) performed a motion coherence task and three equivalent noise (averaging) tasks, the latter allowing independent quantification of local and global limits on visual processing of motion, orientation and size. All performance measures were indistinguishable between the two groups (ps>0.05, one-way ANCOVAs), with one exception: participants with schizophrenia pooled fewer estimates of local orientation than controls when estimating average orientation (p = 0.01, one-way ANCOVA). These data do not support the notion of a generalised visual integration deficit in schizophrenia. Instead, they suggest that distinct visual dimensions are differentially affected in schizophrenia, with a specific impairment in the integration of visual orientation information.     

Contour saliency in primary visual cortex

Contour integration is an important intermediate stage of object recognition, in which line segments belonging to an object boundary are perceptually linked and segmented from complex backgrounds. Contextual influences observed in primary visual cortex (V1) suggest the involvement of V1 in contour integration. Here, we provide direct evidence that, in monkeys performing a contour detection task, there was a close correlation between the responses of V1 neurons and the perceptual saliency of contours. Receiver operating characteristic analysis showed that single neuronal responses encode the presence or absence of a contour as reliably as the animal's behavioral responses. We also show that the same visual contours elicited significantly weaker neuronal responses when they were not detected in the detection task, or when they were unattended. Our results demonstrate that contextual interactions in V1 play a pivotal role in contour integration and saliency.     

Stimulus Roving and Flankers Affect Perceptual Learning of Contrast Discrimination in Macaca mulatta

‘Stimulus roving’ refers to a paradigm in which the properties of the stimuli to be discriminated vary from trial to trial, rather than being kept constant throughout a block of trials. Rhesus monkeys have previously been shown to improve their contrast discrimination performance on a non-roving task, in which they had to report the contrast of a test stimulus relative to that of a fixed-contrast sample stimulus. Human psychophysics studies indicate that roving stimuli yield little or no perceptual learning. Here, we investigate how stimulus roving influences perceptual learning in macaque monkeys and how the addition of flankers alters performance under roving conditions. Animals were initially trained on a contrast discrimination task under non-roving conditions until their performance levels stabilized. The introduction of roving contrast conditions resulted in a pronounced drop in performance, which suggested that subjects initially failed to heed the sample contrast and performed the task using an internal memory reference. With training, significant improvements occurred, demonstrating that learning is possible under roving conditions. To investigate the notion of flanker-induced perceptual learning, flanker stimuli (30% fixed-contrast iso-oriented collinear gratings) were presented jointly with central (roving) stimuli. Presentation of flanker stimuli yielded substantial performance improvements in one subject, but deteriorations in the other. Finally, after the removal of flankers, performance levels returned to their pre-flanker state in both subjects, indicating that the flanker-induced changes were contingent upon the continued presentation of flankers.     

Seeing more than meets the eye: processing of illusory contours in animals

This review article illustrates that mammals, birds and insects are able to perceive illusory contours. Illusory contours lack a physical counterpart, but monkeys, cats, owls and bees perceive them as if they were real borders. In all of these species, a neural correlate for such perceptual completion phenomena has been described. The robustness of neuronal responses and the abundance of cells argue that such neurons might indeed represent a neural correlate for illusory contour perception. The internal state of an animal subject (i.e., alert and behaving) seems to be an important factor when correlating neural activity with perceptual phenomena. The fact that the neural network necessary for illusory contour perception has been found in relatively early visual brain areas in all tested animals suggests that bottom-up processing is largely sufficient to explain such perceptual abilities. However, recent findings in monkeys indicate that feedback loops within the visual system may provide additional modulation. The detection of illusory contours by independently evolved visual systems argues that processing of edges in the absence of contrast gradients reflects fundamental visual constraints and not just an artifact of visual processing.     

Impaired Contingent Attentional Capture Predicts Reduced Working Memory Capacity in Schizophrenia

Although impairments in working memory (WM) are well documented in schizophrenia, the specific factors that cause these deficits are poorly understood. In this study, we hypothesized that a heightened susceptibility to attentional capture at an early stage of visual processing would result in working memory encoding problems. 30 patients with schizophrenia and 28 demographically matched healthy participants were presented with a search array and asked to report the orientation of the target stimulus. In some of the trials, a flanker stimulus preceded the search array that either matched the color of the target (relevant-flanker capture) or appeared in a different color (irrelevant-flanker capture). Working memory capacity was determined in each individual using the visual change detection paradigm. Patients needed considerably more time to find the target in the no-flanker condition. After adjusting the individual exposure time, both groups showed equivalent capture costs in the irrelevant-flanker condition. However, in the relevant-flanker condition, capture costs were increased in patients compared to controls when the stimulus onset asynchrony between the flanker and the search array was high. Moreover, the increase in relevant capture costs correlated negatively with working memory capacity. This study demonstrates preserved stimulus-driven attentional capture but impaired contingent attentional capture associated with low working memory capacity in schizophrenia. These findings suggest a selective impairment of top-down attentional control in schizophrenia, which may impair working memory encoding.     

Crowding by invisible flankers

Background

Human object recognition degrades sharply as the target object moves from central vision into peripheral vision. In particular, one''s ability to recognize a peripheral target is severely impaired by the presence of flanking objects, a phenomenon known as visual crowding. Recent studies on how visual awareness of flanker existence influences crowding had shown mixed results. More importantly, it is not known whether conscious awareness of the existence of both the target and flankers are necessary for crowding to occur.

Methodology/Principal Findings

Here we show that crowding persists even when people are completely unaware of the flankers, which are rendered invisible through the continuous flash suppression technique. Contrast threshold for identifying the orientation of a grating pattern was elevated in the flanked condition, even when the subjects reported that they were unaware of the perceptually suppressed flankers. Moreover, we find that orientation-specific adaptation is attenuated by flankers even when both the target and flankers are invisible.

Conclusions

These findings complement the suggested correlation between crowding and visual awareness. What''s more, our results demonstrate that conscious awareness and attention are not prerequisite for crowding.     

Chromatic collinear facilitation, further evidence for chromatic form perception

Collinear facilitation of contrast detection of achromatic stimuli has been studied over the past decade by different groups. We measured collinear facilitation of chromatic contrast detection under equal-luminance (photometric quantity) and under isoluminance (minimum motion technique) conditions, as two different controls. The facilitation was tested for chromatic contrast detection of a foveal Gabor signal flanked by two high chromatic-contrast Gabor signals. The results indicated a significant facilitation in the presence of spatial adjacent collinear chromatic contrast signals, when the flankers were located at a short distance, across all observers for three chromatic channels. The facilitation was compared to a non-collinear flanker configuration. The results indicated no facilitation effect at the opposing phase configuration, at a short flanker distance, whereas a small facilitation was observed with a configuration at a longer flanker distance. The findings suggest that the performance and specificity of chromatic collinear facilitation is not impaired with regard to achromatic mechanisms.     

Functional architecture of long-range perceptual interactions

The pattern of lateral interactions in the primary visual cortex, which has emerged from recent studies, conforms to the grouping rules of similarity, proximity, smoothness and closure. The goal of this paper is to understand the perceptual salience of oriented elements that are specifically organized to form a smooth contour. An overview of recent studies, in combination with new experimental results, is presented here to emphasis the idea that visual responses depend on input from both the center and the surround of the classical receptive field (CRF). It is assumed that normal lateral interactions produce a neuronal network that is formed by two antagonistic mechanisms: (i) excitation, that is spatially organized along the optimal orientation (collinear), and is predominant near the contrast threshold of the neuron, and (ii) inhibition, that is less selective and is distributed diffusely around the cell's response field. Thus, the inputs from the CRF and the anisotropic surround are summated non-linearly. The specificity of the facilitation and suppression along the collinear direction suggests the existence of second-order elongated collinear filters, which may increase the response similarity between neurons responding to elongated stimulus, thus may enhance the perceptual salience of anisotropic configurations such as contours. This causal connection is particularly evident in amblyopes, where abnormal development of the network results in the abnormal perception of contours.     

Perceptual organization at attended and unattended locations

This study examined the effects of attention on forming perceptual units by proximity grouping and by uniform connectedness (UC). In Experiment 1 a row of three global letters defined by either proximity or UC was presented at the center of the visual field. Participants were asked to identify the letter in the middle of stimulus arrays while ignoring the flankers. The stimulus onset asynchrony (SOA) between stimulus arrays and masks varied between 180 and 500 ms. We found that responses to targets defined by proximity grouping were slower than to those defined by UC at median SOAs but there were no differences at short or long SOAs. Incongruent flankers slowed responses to targets and this flanker compatibility effect was larger for UC than for proximity-defined flankers. Experiment 2 examined the effects of spatial precueing on discrimination responses to proximity- and UC-defined targets. The advantage for targets defined by UC over targets defined by proximity grouping was greater at uncued relative to cued locations. The results suggest that the advantage for UC over proximity grouping in forming perceptual units is contingent on the stimuli not being fully attended, and that paying attention to the stimuli differentially benefits proximity grouping.     

Perceptual organization at attended and unattended locations

In order to perceive complex visual scenes, the human perceptual system has to organize discrete enti-ties in the visual field into chunks or perceptual units for higher-level processing. Perceptual organization is governed by Gestalt principles such as proximity, similarity, and continuity[1]. Thus spatially close ob-jects tend to be grouped together, as do elements that are similar to one another. Grouping based on the Ge-stalt laws (particularly proximity) is critical for the perception of…     

Reducing crowding by weakening inhibitory lateral interactions in the periphery with perceptual learning

We investigated whether lateral masking in the near-periphery, due to inhibitory lateral interactions at an early level of central visual processing, could be weakened by perceptual learning and whether learning transferred to an untrained, higher-level lateral masking known as crowding. The trained task was contrast detection of a Gabor target presented in the near periphery (4°) in the presence of co-oriented and co-aligned high contrast Gabor flankers, which featured different target-to-flankers separations along the vertical axis that varied from 2λ to 8λ. We found both suppressive and facilitatory lateral interactions at target-to-flankers distances (2λ - 4λ and 8λ, respectively) that were larger than those found in the fovea. Training reduces suppression but does not increase facilitation. Most importantly, we found that learning reduces crowding and improves contrast sensitivity, but has no effect on visual acuity (VA). These results suggest a different pattern of connectivity in the periphery with respect to the fovea as well as a different modulation of this connectivity via perceptual learning that not only reduces low-level lateral masking but also reduces crowding. These results have important implications for the rehabilitation of low-vision patients who must use peripheral vision to perform tasks, such as reading and refined figure-ground segmentation, which normal sighted subjects perform in the fovea.     

Binocular Flash Suppression in the Primary Visual Cortex of Anesthetized and Awake Macaques

Primary visual cortex (V1) was implicated as an important candidate for the site of perceptual suppression in numerous psychophysical and imaging studies. However, neurophysiological results in awake monkeys provided evidence for competition mainly between neurons in areas beyond V1. In particular, only a moderate percentage of neurons in V1 were found to modulate in parallel with perception with magnitude substantially smaller than the physical preference of these neurons. It is yet unclear whether these small modulations are rooted from local circuits in V1 or influenced by higher cognitive states. To address this question we recorded multi-unit spiking activity and local field potentials in area V1 of awake and anesthetized macaque monkeys during the paradigm of binocular flash suppression. We found that a small but significant modulation was present in both the anesthetized and awake states during the flash suppression presentation. Furthermore, the relative amplitudes of the perceptual modulations were not significantly different in the two states. We suggest that these early effects of perceptual suppression might occur locally in V1, in prior processing stages or within early visual cortical areas in the absence of top-down feedback from higher cognitive stages that are suppressed under anesthesia.     

United we sense, divided we fail: context-driven perception of ambiguous visual stimuli

Ambiguous visual stimuli provide the brain with sensory information that contains conflicting evidence for multiple mutually exclusive interpretations. Two distinct aspects of the phenomenological experience associated with viewing ambiguous visual stimuli are the apparent stability of perception whenever one perceptual interpretation is dominant, and the instability of perception that causes perceptual dominance to alternate between perceptual interpretations upon extended viewing. This review summarizes several ways in which contextual information can help the brain resolve visual ambiguities and construct temporarily stable perceptual experiences. Temporal context through prior stimulation or internal brain states brought about by feedback from higher cortical processing levels may alter the response characteristics of specific neurons involved in rivalry resolution. Furthermore, spatial or crossmodal context may strengthen the neuronal representation of one of the possible perceptual interpretations and consequently bias the rivalry process towards it. We suggest that contextual influences on perceptual choices with ambiguous visual stimuli can be highly informative about the neuronal mechanisms of context-driven inference in the general processes of perceptual decision-making.     

Grouping and Crowding Affect Target Appearance over Different Spatial Scales

Crowding is the impairment of peripheral target perception by nearby flankers. A number of recent studies have shown that crowding shares many features with grouping. Here, we investigate whether effects of crowding and grouping on target perception are related by asking whether they operate over the same spatial scale. A target letter T had two sets of flanking Ts of varying orientations. The first set was presented close to the target, yielding strong crowding. The second set was either close enough to cause crowding on their own or too far to cause crowding on their own. The Ts of the second set had the same orientation that either matched the target’s orientation (Grouped condition) or not (Ungrouped condition). In Experiment 1, the Grouped flankers reduced crowding independently of their distance from the target, suggesting that grouping operated over larger distances than crowding. In Experiments 2 and 3 we found that grouping did not affect sensitivity but produced a strong bias to report that the grouped orientation was present at the target location whether or not it was. Finally, we investigated whether this bias was a response or perceptual bias, rejecting the former in favor of a perceptual grouping explanation. We suggest that the effect of grouping is to assimilate the target to the identity of surrounding flankers when they are all the same, and that this shape assimilation effect differs in its spatial scale from the integration effect of crowding.     

Cortical Surround Interactions and Perceptual Salience via Natural Scene Statistics

Spatial context in images induces perceptual phenomena associated with salience and modulates the responses of neurons in primary visual cortex (V1). However, the computational and ecological principles underlying contextual effects are incompletely understood. We introduce a model of natural images that includes grouping and segmentation of neighboring features based on their joint statistics, and we interpret the firing rates of V1 neurons as performing optimal recognition in this model. We show that this leads to a substantial generalization of divisive normalization, a computation that is ubiquitous in many neural areas and systems. A main novelty in our model is that the influence of the context on a target stimulus is determined by their degree of statistical dependence. We optimized the parameters of the model on natural image patches, and then simulated neural and perceptual responses on stimuli used in classical experiments. The model reproduces some rich and complex response patterns observed in V1, such as the contrast dependence, orientation tuning and spatial asymmetry of surround suppression, while also allowing for surround facilitation under conditions of weak stimulation. It also mimics the perceptual salience produced by simple displays, and leads to readily testable predictions. Our results provide a principled account of orientation-based contextual modulation in early vision and its sensitivity to the homogeneity and spatial arrangement of inputs, and lends statistical support to the theory that V1 computes visual salience.     

No Evidence for Prolonged Visible Persistence in Patients with Schizophrenia

Background

Temporal visual processing is strongly deteriorated in patients with schizophrenia. For example, the interval required between a visual stimulus and a subsequent mask has to be much longer in schizophrenic patients than in healthy controls. We investigated whether this deficit in temporal resolution is accompanied by prolonged visual persistence and/or deficient temporal precision (temporal asynchrony perception).

Methodology/Principal Findings

We investigated visual persistence in three experiments. In the first, measuring temporal processing by so-called backward masking, prolonged visible persistence is supposed to decrease performance. In the second experiment, requiring temporal integration, prolonged persistence is supposed to improve performance. In the third experiment, we investigated asynchrony detection, as another measure of temporal resolution. Eighteen patients with schizophrenia and 15 healthy controls participated. Asynchrony detection was intact in the patients. However, patients'' performance was inferior compared to healthy controls in the first two experiments. Hence, temporal processing in schizophrenic patients is indeed significantly impaired but this impairment is not caused by prolonged temporal integration.

Conclusions/Significance

Our results argue against a generally prolonged visual persistence in patients with schizophrenia. Together with the preserved ability of patients, to detect temporal asynchronies in permanently presented stimuli, the results indicate a more specific deficit in temporal processing of schizophrenic patients.     

Integration of Retinal and Extraretinal Information across Eye Movements

Visual perception is burdened with a highly discontinuous input stream arising from saccadic eye movements. For successful integration into a coherent representation, the visuomotor system needs to deal with these self-induced perceptual changes and distinguish them from external motion. Forward models are one way to solve this problem where the brain uses internal monitoring signals associated with oculomotor commands to predict the visual consequences of corresponding eye movements during active exploration. Visual scenes typically contain a rich structure of spatial relational information, providing additional cues that may help disambiguate self-induced from external changes of perceptual input. We reasoned that a weighted integration of these two inherently noisy sources of information should lead to better perceptual estimates. Volunteer subjects performed a simple perceptual decision on the apparent displacement of a visual target, jumping unpredictably in sync with a saccadic eye movement. In a critical test condition, the target was presented together with a flanker object, where perceptual decisions could take into account the spatial distance between target and flanker object. Here, precision was better compared to control conditions in which target displacements could only be estimated from either extraretinal or visual relational information alone. Our findings suggest that under natural conditions, integration of visual space across eye movements is based upon close to optimal integration of both retinal and extraretinal pieces of information.