Visual search in peripheral vision: learning effects and set-size dependence.

Feature search for a light bar with one orientation (or color) embedded in an array of bars with a very different orientation (or color) is quick, easy and independent of the number of array elements. In contrast, search for a conjunction target has a linear response time dependence on the number of distractors. Training can improve performance of both these tasks. We report that these properties may not be valid for eccentric stimulus presentation. In general, the two hemifields are not equally suited to search, and training is most effective in the weaker hemifield. In addition, the feature-search independence of set-size may not always be valid for stimulus arrays that are presented peripherally. Subjects were tested on orientation and color feature tasks, and on orientation-color conjunction search with 3 array sizes presented at fixation or eccentrically in the right or left hemifield. During a second testing session, improvement was so much greater for the non-preferred hemifield that sometimes the preference was switched. Surprisingly, preferred hemifield performance actually declined for some subjects. Thus, the hemifield preference effect seems related to competition, and perhaps an automatic attention-directing mechanism. We confirmed the central presentation set-size independence for feature search but found a great difference between large and small arrays when presentation was lateral. There are two sources of this array size effect: 1. Target eccentricity, demonstrated by comparing performance for different target locations with the same array size. 2. Target location uncertainty, seen by comparing performance for different size arrays when the target elements appeared at the same locations. Training also affected the array-size dependence, changing search performance from set-size dependent to independent or vice versa at the point of greatest training effect.     

Neuronal correlates of the set-size effect in monkey lateral intraparietal area

It has long been known that the brain is limited in the amount of sensory information that it can process at any given time. A well-known form of capacity limitation in vision is the set-size effect, whereby the time needed to find a target increases in the presence of distractors. The set-size effect implies that inputs from multiple objects interfere with each other, but the loci and mechanisms of this interference are unknown. Here we show that the set-size effect has a neural correlate in competitive visuo-visual interactions in the lateral intraparietal area, an area related to spatial attention and eye movements. Monkeys performed a covert visual search task in which they discriminated the orientation of a visual target surrounded by distractors. Neurons encoded target location, but responses associated with both target and distractors declined as a function of distractor number (set size). Firing rates associated with the target in the receptive field correlated with reaction time both within and across set sizes. The findings suggest that competitive visuo-visual interactions in areas related to spatial attention contribute to capacity limitations in visual searches.     

Set-size effects for spatial frequency change and discrimination in multiple targets

In visual search tasks with a near-threshold target amongst distracters, log detection thresholds rise in proportion to the log of the number of stimuli. Previous research has shown a very steep slope for this set-size effect where the target is a change in spatial frequency (SF) across an ISI, suggesting a low-level explanation for 'change blindness (Wright et al., 2000). Here, we analyse stimulus and task variables in order to determine the contributions of stimulus detection and attention processes. Stimuli consisted of two 150 ms frames each containing 1 to 4 Gabor targets, with an ISI of 250 ms. In a 2AFC detection task with uniform distracters, slopes of 0.23-0.52 were found, in line with visual search results. 2AFC SF discrimination tasks gave slopes of 0.68, 0.69 with homogeneous distracters and 0.76-0.96 with inhomogeneous distracters, consistent with averaging of stimuli within a frame. If the distracters were also made to change across ISI, averaging was impossible, and focal attention was required to solve the discrimination. This always gave set-size slopes > 1. It is concluded that, under conditions where a stimulus array can be analysed globally, change detection performance is limited by signal detection mechanisms, rather than limited capacity attention or memory mechanisms. However, where this is prevented, for example by changing more than one item, limitations due to attention or memory produce an even steeper set-size effect.     

Attentional weighting: a possible account of visual field asymmetries in visual search?

Several previous visual search studies measuring reaction times have demonstrated scanning biases across the visual field (i.e. a tendency to begin a serial search in a particular region of space). In the present study, we measured visual discrimination thresholds for a target presented amongst distractors using displays that were short enough to greatly reduce the potential for serial (i.e. scanning) search. For both a motion and orientation task, subjects' performance was significantly better when the target appeared in the inferior, as compared to the superior, visual field (no differences were observed between left and right visual fields). These findings suggest that subjects may divide attention unevenly across the visual field when searching for a target amongst distractors, a phenomenon we refer to as 'attentional weighting'. To rule out the possibility that these visual field asymmetries were sensory in nature, thresholds were also measured for conditions in which subjects' attention was directed to the location of the target stimulus, either because it was presented alone in the display or because a spatial cue directed subjects' attention to the location of that target presented amongst distractors. Under these conditions, visual field asymmetries were smaller (or non-existent), suggesting that sensory factors (such as crowding) are unlikely to account for our results. In addition, analyses of set-size effects (obtained by comparing thresholds for a single target vs. the target presented amongst distractors) could be accounted for by an unlimited capacity model, suggesting that multiple stimuli can be processed simultaneously without any limitations at an early stage of sensory processing. Taken together, these findings suggest the possible existence of biases in attentional weighting at a late stage of processing. The bias appears to favor the inferior visual field, which may arise from the fact that there is more ecologically-relevant information in this region of space.     

Effect of harmonicity on the detection of a signal in a complex masker and on spatial release from masking

The amount of masking of sounds from one source (signals) by sounds from a competing source (maskers) heavily depends on the sound characteristics of the masker and the signal and on their relative spatial location. Numerous studies investigated the ability to detect a signal in a speech or a noise masker or the effect of spatial separation of signal and masker on the amount of masking, but there is a lack of studies investigating the combined effects of many cues on the masking as is typical for natural listening situations. The current study using free-field listening systematically evaluates the combined effects of harmonicity and inharmonicity cues in multi-tone maskers and cues resulting from spatial separation of target signal and masker on the detection of a pure tone in a multi-tone or a noise masker. A linear binaural processing model was implemented to predict the masked thresholds in order to estimate whether the observed thresholds can be accounted for by energetic masking in the auditory periphery or whether other effects are involved. Thresholds were determined for combinations of two target frequencies (1 and 8 kHz), two spatial configurations (masker and target either co-located or spatially separated by 90 degrees azimuth), and five different masker types (four complex multi-tone stimuli, one noise masker). A spatial separation of target and masker resulted in a release from masking for all masker types. The amount of masking significantly depended on the masker type and frequency range. The various harmonic and inharmonic relations between target and masker or between components of the masker resulted in a complex pattern of increased or decreased masked thresholds in comparison to the predicted energetic masking. The results indicate that harmonicity cues affect the detectability of a tonal target in a complex masker.     

Fast noninertial shifts of attention

It was suggested that some discrimination tasks (e.g. discrimination between the letters T and L) require serial search by scrutinizing each letter (target) with a small aperture of focal attention. Here we examine the effect of intertarget distance on discrimination performance, using two targets. We find reduction in performance at short distances, in agreement with masking studies, but constant performance independent of distance outside this masking region. This constant performance is still lower than expected from masking effects and might reflect attentive process. Sequential presentation of the targets with delays up to 30-40 ms, while reducing available processing time, does not cause reduction in performance, thus supporting the suggestion that discrimination of the two targets is a serial process. The independence of performance on distance suggests fast noninertial shifts of attention.     

Modelling eye movements in a categorical search task

We introduce a model of eye movements during categorical search, the task of finding and recognizing categorically defined targets. It extends a previous model of eye movements during search (target acquisition model, TAM) by using distances from an support vector machine classification boundary to create probability maps indicating pixel-by-pixel evidence for the target category in search images. Other additions include functionality enabling target-absent searches, and a fixation-based blurring of the search images now based on a mapping between visual and collicular space. We tested this model on images from a previously conducted variable set-size (6/13/20) present/absent search experiment where participants searched for categorically defined teddy bear targets among random category distractors. The model not only captured target-present/absent set-size effects, but also accurately predicted for all conditions the numbers of fixations made prior to search judgements. It also predicted the percentages of first eye movements during search landing on targets, a conservative measure of search guidance. Effects of set size on false negative and false positive errors were also captured, but error rates in general were overestimated. We conclude that visual features discriminating a target category from non-targets can be learned and used to guide eye movements during categorical search.     

Recognition of forward-masked complex and simple images

The accuracy and time of motor response in tests for visual recognition of simple (sets of horizontal and vertical lines, angles, and crosses) and complex (contour images of animate and inanimate objects) images forward-masked with stimuli of varying complexity were estimated in psychophysiological experiments. It was found that forward masking impaired recognition, the mask whose complexity was close to that of the given test image being the most efficient in each particular case. The masking effect was the strongest in the experiments where the sets of test and masking images coincided. Recognition of complex images proved to be more resistant to masking than recognition of simple images. The observed effects of forward masking are assumed to be determined by lateral inhibition and changes in the excitability cycle. The relative contributions of these mechanisms depend on the degree of similarity between the test and masking stimuli, as well as the hierarchical level of the visual cortex at which the test stimulus is “targeted.”     

Exploring BOLD Changes during Spatial Attention in Non-Stimulated Visual Cortex

Blood oxygen level-dependent (BOLD) responses were measured in parts of primary visual cortex that represented unstimulated visual field regions at different distances from a stimulated central target location. The composition of the visual scene varied by the presence or absence of additional peripheral distracter stimuli. Bottom-up effects were assessed by comparing peripheral activity during central stimulation vs. no stimulation. Top-down effects were assessed by comparing active vs. passive conditions. In passive conditions subjects simply watched the central letter stimuli and in active conditions they had to report occurrence of pre-defined targets in a rapid serial letter stream. Onset of the central letter stream enhanced activity in V1 representations of the stimulated region. Within representations of the periphery activation decreased and finally turned into deactivation with increasing distance from the stimulated location. This pattern was most pronounced in the active conditions and during the presence of peripheral stimuli. Active search for a target did not lead to additional enhancement at areas representing the attentional focus but to a stronger deactivation in the vicinity. Suppressed neuronal activity was also found in the non distracter condition suggesting a top-down attention driven effect. Our observations suggest that BOLD signal decreases in primary visual cortex are modulated by bottom-up sensory-driven factors such as the presence of distracters in the visual field as well as by top-down attentional processes.     

Reducing crowding by weakening inhibitory lateral interactions in the periphery with perceptual learning

We investigated whether lateral masking in the near-periphery, due to inhibitory lateral interactions at an early level of central visual processing, could be weakened by perceptual learning and whether learning transferred to an untrained, higher-level lateral masking known as crowding. The trained task was contrast detection of a Gabor target presented in the near periphery (4°) in the presence of co-oriented and co-aligned high contrast Gabor flankers, which featured different target-to-flankers separations along the vertical axis that varied from 2λ to 8λ. We found both suppressive and facilitatory lateral interactions at target-to-flankers distances (2λ - 4λ and 8λ, respectively) that were larger than those found in the fovea. Training reduces suppression but does not increase facilitation. Most importantly, we found that learning reduces crowding and improves contrast sensitivity, but has no effect on visual acuity (VA). These results suggest a different pattern of connectivity in the periphery with respect to the fovea as well as a different modulation of this connectivity via perceptual learning that not only reduces low-level lateral masking but also reduces crowding. These results have important implications for the rehabilitation of low-vision patients who must use peripheral vision to perform tasks, such as reading and refined figure-ground segmentation, which normal sighted subjects perform in the fovea.     

Spatial interactions in simple and combined-feature visual search.

To isolate the mechanisms responsible for spatial interactions in visual search, we investigated the effects of inter-element distance and positional jittering in both simple (in/s) and combined-feature (inverted V in Vs) search tasks in which the observer had to find a target in a background of similar nontargets. Thresholds, defined as the stimulus duration for 75% correct, were measured for 'present' and 'absent' target conditions as a function of background numerosity (ranging from 4 to 64 background elements), independently for four inter-element distances and three positional jittering conditions. Results show: (1) both simple and combined-feature search involve a parallel, capacity limited process, (2) thresholds for parallel search of simple features are directly related to inter-element distance whereas this has little effect on thresholds in combined-feature search, and (3) positional jittering has a direct effect on thresholds in combined-feature search and an inverse effect in simple-feature search. These results indicate that two different mechanisms of spatial interactions are involved in parallel search. The activation of each of the two mechanisms depends on the stimulus used. In parallel search for simple and dissimilar features, the underlying mechanism is a short-range one, based on lateral inhibition, whereas the parallel search for combined and similar features is based on a nontarget grouping mechanism which relies on facilitatory interactions between regular elements.     

Behavioral and electrographical features of recognition of forward-masked complex images: The effect of categorical similarity of the target and masking stimuli

In psychophysical and neurophysiological experiments, the subjects recognized images of two categories, “animals” and “objects.” The images of the same categories differing from the target stimuli were used as the masking stimuli. We found that the efficacy of forward-masking depended on categorical similarity of the masking and target stimuli. The probability of a correct response was lower and the reaction time and its variance were higher when we used stimuli of the same category compared with presentation of stimuli of different categories. Categorical similarity of masking and target stimuli induced difficulties with response, which were accompanied by decreases in the amplitudes of the N2 and P3 components of the evoked potentials. These effects were more pronounced during recognition of animals compared to objects. The results are discussed from the point of view of negative priming and the distractor effect.     

Effects of Awareness on Numerosity Adaptation

Numerosity perception is a process involving several stages of visual processing. This study investigated whether distinct mechanisms exist in numerosity adaptation under different awareness conditions to characterize how numerosity perception occurs at each stage. The status of awareness was controlled by masking conditions, in which monoptic and dichoptic masking were proposed to influence different levels of processing. Numerosity adaptation showed significant aftereffects when the participants were aware (monoptic masking) and unaware (dichoptic masking) of adaptors. The interocular transfer for numerosity adaptation was distinct under the different awareness conditions. Adaptation was primarily binocular when participants were aware of stimuli and was purely monocular when participants were unaware of adaptors. Moreover, numerosity adaptation was significantly reduced when the adaptor dots were clustered into chunks with awareness, whereas clustering had no effect on unaware adaptation. These results show that distinct mechanisms exist in numerosity processing under different awareness conditions. It is suggested that awareness is crucial to numerosity cognition. With awareness, grouping (by clustering) influences numerosity coding through altered object representations, which involves higher-level cognitive processing.     

Study of effects of low level microwave field by method of face masking

The aim of this study was to examine experimentally effects of low level, modulated microwaves on human central nervous system function utilizing the phenomenon of visual masking. Ten healthy volunteers, four males and six females, were exposed to electromagnetic field (450 MHz, 0.16 mW/cm2) with 7 Hz modulation frequency. Two photo series (visual stimuli) of unfamiliar, young male faces were presented to the subjects, one picture after another. All the photos were frontal views of unfamiliar faces, which could be recognized only by their unique combinations of features. The task was to identify the pictures from a group of six photos and to decide which order they were presented in. The phenomenon of visual masking is revealed as anamorphosis in subject's perception of two instantaneous visual stimuli presented within a short time interval. When both stimuli were to be recognized correctly and put in the right order, there was a statistically significant difference (P < 0.05) between the identification of the stimulus with microwave electromagnetic field and sham exposure. Recognition of both stimuli in a pair was better under the sham exposure conditions but the actual difference was only 5%. It was concluded that early stages of visual information processing are overwhelmingly robust and routine (and adaptively significant) activities, so that the low level 7 Hz modulated electromagnetic field effects exerted upon it are extremely weak.     

Visual search and event-related potentials in the extrastriate cortical areas in humans

Parameters of visual search (reaction time, mistakes) were investigated in 11 young healthy volunteers, under changing parameters of target symbol (form, color and location) in surroundings of white distracters (flankers). In 6 cortical leads: P3, P4, T3, T4, T5, T6, monopolar event-related potentials (ERPs) were registered and analyzed for the late endogenous components: N2, P3, because these very components have changed under verifying of search (so called late selection). In the hard search (similar target and distractors) the increase of search time was accompanied by the delay of P3 component and diminishing of its amplitude. The definite (the knowledge of) target position resulted by the decrease search time and decrease of P3 wave latency as compared with situation of uncertainty in respect to the position of target. Alteration of the target stimulus colour were led to abolishment (cancel) of inhibition effect of distracters: parameters of IRP have not differed from parameters of ERPs to solid target stimulus without the flankers. A high correlation of search time and parameters of P3 wave was revealed. Changes of IRPs in different kinds of search were similar in parietal and temporal leads. This suggests that the parietal and temporal cortical areas function as united system, under search of target in environment.     

Spatial cueing,sensory gating and selective response preparation: an ERP study on visuo-spatial orienting

Event-related brain potentials (ERPs) were recorded in a visuo-spatial attention task where the position of an imperative stimulus was indicated either validly or invalidly by a central arrow (trial-by-trial cueing). Subjects had to perform choice RT tasks with the response being dependent either on the identity of the target stimulus or on its position. When target identity was relevant for response selection, validly cued stimuli elicited amplitude enhancements of the early, sensory-evoked P1 and N1 components at lateral posterior sites. The N1 validity effect was limited to scalp sites ipsilateral to the visual field of stimulus presentation. Although these effects were found only when the sensory discrimination task was considerably difficult, they are in line with models assuming that modulations of sensory-perceptual processing (“sensory gating”) are induced by spatial cueing. However, when target location was response-relevant, N1 amplitude enhancements were consistently elicited by invalidly cued letters.CNV and LRP measures indicated that the arrow elicited response-related processing in the cue-target interval. Such processes occurred even when the cue contained no information about an upcoming response. Two consecutive lateralization phases were distinguishable in the LRP, with experimentally induced response assignments becoming effective only during the second phase.     

Mismatch field to tone pairs: neuromagnetic evidence for temporal integration at the sensory level

The mismatch field (MMF) to minor pitch changes in two experimental conditions was studied. Standard tones of 1000 Hz and deviant tones of 1050 Hz both of 50 ms duration were delivered in single tone condition. Paired tones of the same duration were used in the paired tone condition. The standard tone pair consisted of two 1000 Hz tones, whereas the deviant tone pair was composed of a 1000 Hz tone in the first position and a 1050 Hz tone in the second position with a silent interval of 15 ms between the two. Standards of 90% and deviants of 10% probability were presented in random order and with a randomized interstimulus interval between 600 and 900 ms. The source analysis showed a more lateral location for the MMF obtained in the paired tone condition (MMF.P) compared to the MMF elicited by the single deviants (MMF.S). The source location of both the MMF.P and MMF.S turned out to be significantly anterior relative to the sources of the M100. The increased stimulus repetition in the paired tone condition (two times more stimuli than in the single tone condition) lead to a strong suppression of the field amplitude and of the dipole moment of the M100, while this effect could not be seen for the MMF. The data demonstrate a fundamental difference between the processes reflected by the M100 and the MMF: while the M100 represents the processing of every individual tone, the MMF reflects the change detection of the paired stimuli as unitary events, forming a perceptual group. The different sources of the MMF.P and MMF.S also support an integrated processing of the paired stimuli.     

持续与间断噪声前掩蔽条件下小鼠下丘神经元的不同反应模式

有关听中枢神经元纯音前掩蔽效应的神经表征已进行了大量研究,但是,噪声前掩蔽尤其是间断噪声前掩蔽效应的神经表征却鲜有报道。本研究观察了自由声场条件下,昆明小鼠下丘神经元在持续与间断噪声前掩蔽条件下对纯音探测声的反应。共记录到96个下丘神经元,测量了其中51个神经元在不同声刺激条件下的强度一放电率函数。结果显示,掩蔽声强度分布较广（探测声阈下21dB至阈上19dB之间）。在将近一半的神经元中,间断噪声的前掩蔽效应比持续噪声强（Ⅰ型,45．10％,P〈0．001）,但也有少数神经元其间断噪声的掩蔽效应较持续噪声的弱（Ⅲ型,17．65％,P〈0．001）,部分神经元无显著性差异（Ⅱ型,37．25％,P〉0．05）。无论Ⅰ型还是Ⅲ型神经元,持续噪声和间断噪声均在探测声强度较低时产生较强的抑制效应,随着探测声强度的升高,抑制效应逐渐降低（P〈0．001）;同时,持续噪声和间断噪声之间前掩蔽效应差异亦不复存在（P〉0．05）。此外,当掩蔽声由持续噪声换为间断噪声后,部分Ⅰ型神经元掩蔽时相的类型发生转变,其中最主要的转变为由前期抑制转变为均衡抑制（53．85％,7／13）。对下丘神经元声反应的时间域以及强度域,持续与间断噪声具有分化性前掩蔽效应,提示噪声前掩蔽并非简单的神经元发放压抑源,某些主动性神经调制机制可能参与了噪声条件下时相声信息的编码过程。     

A model of visual backward masking

When two successive stimuli are presented within 0-200 ms intervals, the recognition of the first stimulus (the target) can be impaired by the second (the mask). This backward masking phenomenon has a form called metacontrast masking where the target and the mask are in close spatial proximity but not overlapping. In that case, the masking effect is strongest for interval of 60-100 ms. To understand this behaviour, activity propagation in a feedforward network of leaky integrate and fire neurons is investigated. It is found that, if neurons have a selectivity similar to that of V1 simple cells, activity decays layer after layer and ceases to propagate. To combat this, a local amplification mechanism is included in the model, using excitatory lateral connections, which turn out to support prolonged self-sustained activity. Masking is assumed to arise from local competition between representations recruited by the target and the mask. This tends to interrupt sustained firing, while prolonged retinal input tends to re-initiate it. Thus, masking causes a maximal reduction of the duration of the cortical response to the target towards the end of the retinal response. This duration exhibits the typical U-shape of the masking curve. In this model, masking does not alter the propagation of the onset of the response to the target, thus preserving response reaction times and enabling unconscious priming phenomena.     

Use of backward masking test for the study of visual information processing in healthy subjects and schizophrenic patients

The study of 14 healthy subjects and 15 schizophrenic patients was conducted under visual backward masking conditions. Sensory thresholds were identified using the method of constant stimuli. A special modification of the backward masking technique with lateralized presentation of test and masking stimuli was used to study the lateral characteristics of visual attention. It was found that the thresholds of letter stimulus identification were significantly higher in patients with schizophrenia than in healthy subjects. Only in patients the asymmetry of visual perception was revealed with the higher recognition thresholds in the left visual hemifield. The overall data analysis suggests an association between increased recognition thresholds in schizophrenic patients and changes in the interruption mechanism functioning at the neocortex level.